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ON L? ESTIMATES AND REGULARITY, I+: © 


By MARTIN SOHECHTER. 


1. Introduction. In this paper we show how one may estimate the 
H»? norms of solutions of elliptic boundary value problems for all real values 
of sand p>1. These results are of particular interest when s is less than 
the order of the equation. From such estimates one obtains existence, regu- 
larity and representation theorems as well as other results. Details will be 
found in Sectféfis 3 and 6. 

Our estimates are of the form 


lu I,» S const. (|| At llamp + | % lem.) 


for functions satisfying the homogeneous boundary conditions. Here A is an 
elliptic operator of order m; precise hypothesis are given in Sections 3 and 5. 
For s a non-negative integer, the norm | |,» is merely the sum of the Zr 
norms of all derivatives up to order s. For s not an integer it is defined by 
means of Complex interpolation methods introduced’ by Calderén [9] and 
Lions [11] (cf. Section 2). For s negative, the norm is defined by duality. 

As an example of a regularity theorem, we prove that if v is a distribu- 
tion and 

| (Au, v) | S const. || u [mr 

for all C” function u satisfying the homogeneous boundary conditions, then 
v is in H**’, where p’==p/(p—1). We also obtain estimates for v. This 


generalizes a result of Agmon [2] for the Dirichlet problem. 
From this, one easily obtains estimates of the form 


[u ls, SS const. ($ || fs Is+m-m» + |% Im) 
for solutions of 
| Aum E Afo | 
where the A, are differential operators of order mj; m. : Also a very general 
representation theorem is obtained for bilinear forms which satisfy 
a(t, v) = (Au, v) 

for C@ function u,v satisfying homogeneous boundary conditions. 

* Received December 18, 1961; revised July 5, 1962. 

1 Research for this paper was partly supported by the National Science Foundation 


Grant G-8205. 
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Some of these results were announced in the Notices of the American 
Mathematical Soctety, vol. 9 (1962), p. 40. 


2. Interpolation spaces, We make use of the “complex” method of 
interpolation developed by Calderón [9,10] and Lions [11]. Let X, and X, 
be Banach spaces and consider the set H(X, X) of functions f(s- ty) 
which are (a) continuous and bounded in the closed strip 0<Sr=1 with. 
values in X, + X, (b) analytic in O<z<1,and (c) such that f(ty) € Xo, 
f(t +iy) EX. Set 


If Isuzu — max[sup 1#) lxo DER iy) la] 


For any 6 such that 0<#<1, the space [Xo X1;8(0)] is the set of all l 
wE X,+ X, such that w—f(6) for some fE H(Xo,X,). Provided with the 
norm 


| w lirez = inf | f Jaaa 
1@O)=0 


it becomes a Banach space. 
An immediate consequence of the definition is 


(2.1) [X1, Xo38(6) ] = [Zo X138(1—8) J. 
We easily have in addition 


Lemma 2.1. (Calderón [9], Lions [11]). If X, and Y, are Banach 
spaces, 1=~0,1, and T ts a bounded linear mapping of X, into Y, and X, 
into Y., then it can be extended to be a bounded linear map of [Xo, X138(6) | 
into [Yo Y1;8(6) ]. 

The next two important results are due to Calderén [10].? 


Lemma 2.2. If X, is a dense subspace of X., then it is dense in 
[Xo X15 8(6) ]. 


Lemma 2.3. If X, and X, are reflexive, then 
[Xo X18 (0) V = [-Xo’, X15 8(8) J. 


Let @ be a bounded domain in Euclidean n-space E» with boundary 6G 
of class C*.® Let O*(G) be the set of complex valued functions infinitely 
differentiable in the closure G of G. We set 


2 If X, and X, are reflexive, then Lemma 2. 2 follows immediately from Lemma 2.3. ` 
For similar statements for other types. of interpolation, cf. Lions, Math. Scand., vol. 9 
(1961), pp. 147-177. 

°Bome of our assumptions are made for convenience only and can be relaxed 
considerably. l i 
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Í, | Deu |? dz]"? 


for + a non-negative integer and p> 1. The summation is taken over all 
derivatives De of order |a|=Si. We let H+?(G@) denote the completion of 
0° (G) with respect-to the norm (2.2). 

For s positive and not an integer we define H**(@) to be . 


[H+ (G), H(G) ;8(6)], =s — i, 


where t is the greatest integer less than s. For s real and negative, H(G) 
is defined as the completion of C@(G@) with respect to the norm 


ut lsp= lub 1v) 


ver |] ll 


(2.2) lul= i È 


alst 


where BE 
(u,v) -f ud dx 
G 
and p’— p/(p—1). 
The following result is due to Lions-Magenes [12, IIT]. 
LEMMA 2.4. If s, and 8, are non-negative real numbers, then 
[H (G), Her? (@) ;8(0)] = H*r (G), 
where S = (1—#0)s, + b82. i 
3. Boundary problems. Let A be a partial differential operator of order 
m with coefficients in C°(G).* If C.” (G) denotes the set of those functions 
in (*(@) with compact support in G, let V be any space of functions such 
that 
. Co” (4) CV C0” (4). 
We then take V’ to be the set of those ve O” (G) which satisfy 
(u, A) = (Au, v) 
for all ve V, where A’ is the formal adjoint of A. Clearly 0o” (G) CV’. 
We define the following norms for s real and non-negative 
besi a en E 
|w [ap = | w [a= I © len 


l where p'== p/(p— 1). 


‘Cf. footnote 3. 
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For s=0 we let Y®r(@) (resp. V’er(G)) denote the closure of V 
(resp. V’) in H*”(G@). For s <0 we let these symbols denote the closures — 
of C°(G) with respect to the norms | |.» and | |’.,, respectively. Let N 
(resp. N’) be the set of all we V (resp. ve V’) such that Au—0 (resp. 
A’y==0). For any set of functions S, the symbol S/N will denote those 
elements w of S which satisfy (w,w) —=0 for all ue N. We let H-*(G) be 
the union of all the spaces H*?(@), s real and p> 1. 

We make the. following assumptions for some fixed p > 1. 


(a) There is a constant c, such that 
(3.1) [u lmp Co(] Au loo + Iu lop) for all uc V 
(3.2) || © lmp E coll A0 flog + [lv lop) for all ve y. 


(b) For every fe C=(G)/N’ there is a u€ V such that Auf, and 
for every g € 0° (@)/N there is a ve V’ such that A’v=g. 


It has been shown that assumptions (a) and (b) are satisfied for every 
p> 1 when A is a properly elliptic operator and V is determined by a set of 
m/2 differential operators of order < m which cover A (cf. Section 5). 


THEOREM 3.1. For every real number s satisfying Os m there is 
a constant M, such that i 


(3.3) lvl» SS Me(| Au |p + |u lm) for all ue V 
(3.4) lo lay SHMsl| Av emo + || 0 lamer) for all ve V’, 
Tarore 3.2. If uc H(G) and | 
(3.5) |(u,A’v)| Se. |v Img for all ve V’, 
then we Ver(G) and l 
(3.6) ul» S Ma(a + |%lem)- 
Similarly, if ve H- (G) and 
(3.7) |(v,Au)] S c | u Im, for all uE V, 
then v€ V’er(G) and 
(3.8) tler SS Mele. + vlnr). 
THEOREM 3.3. If a(u,v) is a bilinear form satisfying 
(8.9) wo) S Ki fool leer 
(3.10). a(u,v) = (Au, v) 
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for all uc V/N and ve V’/N’ then for every bounded linear functional F on 
Vor(G)/N there ts a ve Ve (G)/N’ such that 
(3.11) Fuma(u,v), wEeVer(@)/N 


For the Dirichlet problem Theorem 3.2 was proved by Agmon for s an 
integer. Theorem 3.1 was proved by Lions-Magenes [12,III] also for the 
Dirichlet problem when N == N’ = 0, s real and satisfying m/2 Ss=m. They 
employed Agmon’s result. 

Let A, de a differential operator of order mm with coefficient in 
0” (G), 1+], where | is an integer >1. 


THEOREM 3.4. For every real number s such that 0 S 8 S m — max mi, 
there is a constant C; such that 


(3.12) I [np E OCE 1 fi lomim + Tu len) 


4=1 


for all u and f; in O” (G) satisfying 
t 
(3.18) (u,A’v) => (f, Av) for ve V. 
: i=l 
1 
In particular, this holds if u€ V, Au = $, Aif and 
= 
t 
(8.14) 2 [fy Arv) — (Af,v)] == 0 for ve V. 
4, Proofs of the theorems. In proving the theorems of the previous 
section we make use of the important 
THEOREM 4.1. If s, and s, are non-negative real numbers, then 
(4.1) [9>(@), V=? (G) ;5)] C V9) 
with continuous injection, where 
S3 = (1— 0) 3, + 639. 


Proof. Let X denote the space on the right hand side of (4.1). The 
identity mapping is bounded from V*»?(G@) into H*»?(@) and from V*? into 
H(G). Hence, by Lemmas 2.1 and 2.4, it is a bounded mapping of X 
into H%?(G@). Thus XCH®r(@) and 


(4.2) lu les» SE | ux 


for all ve X. Assume for definiteness that s, < s: (by (2.1) this entails 
no loss of generality). Since V*?(G@) is dense in V*?(@), we see by Lemma 


6 MARTIN SCHECHTER. 
2.2 that it is dense in X. Thus for each element u€ X there is a sequence 
{us} of elements in V*?(G@) such that 

] Uug — t | x> 0. 


By (4.2) this sequence forms a Cauchy sequence in H*?(G) and hence con- 
verges to an element we V®»r(G). Since the sequence approaches both u 
and w in H*?(G), we have u= w and the proof is complete. 


Proof of Theorem 3.1. By (8.1) 
|| © Im» Co | % lop 


for all u€ N. Since G is bounded and dG is smooth, every closed bounded set 
in H™?(G@) is compact in HP (G) — L(G) (Rellich’s lemma). Thus N is 
finite dimensional. This means that there is a constant c, such that 


|| % Im SS Cs | Au llop 


for u€ V/N. For otherwise there would exist a sequence {up} of functions 
in V/N such that 


(4.8) || ux lmp = 1, || Aur llop > 0. 


By Rellich’s lemma there is a subsequence which converges in Lr( G). Denoting 
the subsequence again by {ux}, we have by (3.1) 


|| tiy — u Ilan SS (| Alu — ur) lop + I uy — ur lop) 


0 
as j,k—>oo. Thus the u, converge in H™?(G) to an element ve Vrr(G)/N. 
By (4.8) 
(4. 4) . |u [wp == 1 
But by assumption (b), every function w€ C”(G) can be written in the form 
w=—=A’y, + va where v€ V’ and v EN. Hence 
(u, w) = (u, A’v,) + (u, v2) = lim (ur, 4’v,) 
= lim (Aup, v) = 0 i 


for all we C*(G). Thus u—0, contradicting (4.4). Hence (4.2) holds 
and similarly we have f 


(4.5) ' || © lmp S ca | A0 lop 
for ve V’/N’. 
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Next we claim that 
(4.6) 1% lop SCs | Atl’ me 
for all u€ V/N. This follows from the fact that 


EINS M4620 > aap CL O1 

lo lmp "ern |o mr 
Now for each we C"(G@)/N there is a ve V’/N’ such that Av—=w. Thus 
by (4.5) 


, | Au mp 


Ca | Au mp2 lub | (u w) | 
weca |w lop” 


which is easily seen to be = const. || u |jo,»- 

Thus by (4.2), (4.6) and assumption (b), we may consider the inverse 
operator A+ as a continuous mapping of LP(@)/N’ into Vrr(G) and 
Ve (G)/N’ into L*(G). Defining A to be zero on N’ we have, by Lemma 
2.1, that A! is a bounded mapping of 


Lom [Vom (G), Le (G) 58(9)] 


into 

Yo== [Lr (G), V™7(G@) ;8(6)]. 
Thus 
(4.7) |u lly. S co | Aw |x 


for all we V/N. Now by Theorem 4.1 


(4.8) [u lep E cr |u lro 
where s= 6m. Moreover, since V’""?'(G) is the dual space of V’-"™9(G@) (cf. 
[17, Theorem 2.2]) we have by Lemma 2.3 that Xe is the dual of 

[V7 (G), Le (G) ;8(8)] = [2 (9), Pe" (G) 58(1—0) 


By Theorem 4.1, this last space is contained in V"*?'(@) with continuous 
injection. Thus its dual, Xe, contains V’*-”™?(@) with continuous injection. 
Therefore we have 


(4.9) | w las SS cs | w en, 

for we L°(G). Combining (4.7), (4.8), and (4.9) we have 

(4.10) Ju lan S co | Au emp 

for ue V/N. Now if uc V, then u =w +u”, where we V/N and u”eN. 
Thus e 


fu ley E Iw lep + I uw” lap S co | Au | smp + C10 | W” om.» 
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since N is finite dimensional (cf. [17, Lemma 7.1]). But 
|" lemo | t lem» + I lle S Iu oma + Co | Au Yon 
and (3.3) follows immediately. The proof of (8.4) is similar and is omitted. 


Proof of Theorem 3.2. By (3.5), (A’v,w) is a bounded linear func- 
tional on P'e?’ (Q). Thus there is an element f € Y’r"r(G) such that 


(4.11) (u, A’v) = (fv) 
and 
(4. 12) | f Pr = Cy. 


Clearly (f, N’) <0. Now there is a sequence {fx} of functions in O” (G) 
such that |fz—f|’smp—>0. Moreover for each k, fr fr + fr”, where 
(Fk N’) =0 and f'E N’. For each we N’ 


(fes w) = (fr— fr, w) — 0. 


Since N’ is finite dimensional, the fẹ” converge to zero in L?(@). Thus 
| fi’ —f em» > 0. Now for each fi’ there is a uy € V/N such that Au, = fy. 
Thus by (4.10) 


u; — Ux llap 0 


showing that they converge in H*?(G@) to an element we V%?(@). More- 
over for ve V’ 


(4.18) (u, A’v) = lim (ur, A’v) = lim (Aux, v) = (f,v). 
Subtracting (4.13) from (4.11) we have 
(u— Us, A’v) =0. 
But u— to =u -+ u”, where (W,N)=0 and wW’EeN. Hence 
(w, A’v) = 0) 


for all ve V’. But if weC*(G@), we know by assumption (b) that 
w= A’v, + ve, where v, € V’ and vE N. Hence 


(w, w) = (w, Av) + (w, v2) = 0 


showing that w= 0. Thus u—=—tu,+ u” € Vr(G) and the first assertion is 
proved. Inequality (3.6) follows from the fact that u, -+ u” converges to u 
in V®r(G) while A(ur+ w”) =f, converges to f in V’emr(G). Since 


| % lep S Ms(| Atty em.» + | tx |sm,») 
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by (8.3), we have 


|u lep S M. (| f [mp + Iu lem,p). 


This, combined with (4.12), gives (3.6). The second part of the theorem 
is proved similarly. 


Proof of Theorem 3.8. If F is a bounded linear functional on V*?(@)/N, 
then there is age V*(@)/N such that 


(4.14) Fu = (u,g). 


By the reasoning in the proof of Theorem 3.2, there is a ve V’mr'(@)/N’ 
such that 


(4.15) (v, Au) = (9, 4) 


for all we Ver(G)/N. Since (g, N) =0, this holds for all we V"7(G). As 
in the proof of Theorem 3.2, one easily obtains a sequence vs of functions 
in V/N which converges to v in V’™*”'(@). Thus 


(4.16) a(u,v) = lima (u, vg) = lim (Au, vg) = (Au, v). 
Combining (4.14), (4.15), and (4.16) we obtain the desired result. 


Proof of Theorem 3.4. By (8.18), 
1 
| (u, A’) | SBM fe Usim | APY Immun 


1 
S 010 | v leeg al Felsen m,» 


for all v€ V’, where we have made use of the fact that m—s—m,=0 for 
each m, (cf. [18, Lemma 4.3]). Setting 


3 
C1 = Cio = | fi Jlevmsm,ps 
=i 
we apply Theorem 3.2, which tells us that ve V*?(G) and that (3.6) holds. 


5. Some applications. We now consider some situations when hypo- 
potheses (a) and (b) of Section 3 are known to hold. For such cases we can 
immediately conclude that Theorems 3.1-3.4 hold. 

The operator A is elliptic in @ if its characteristic polynomial P (x, é) 
does not vanish for z€ G, € real and not zero. It is properly elliptic in @ if 
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for each boundary point z and each set of linearly independent vectors £9 
and é@) the polynomial in z P(z, &) 4- 2€@)) has m/2 roots above and m/2 
roots below the real axis (this assumes that m is even). Let Ba- + +, Bays be 
differential operators of order less than m with coefficients in C* (8G). We say 
that they cover A if at each point ze 8G the polynomials Q, (£, T + 2N),---, 
Onss(% T-+2N) are linearly independent modulo the polynomial (z—2z,) 
- + +(g—2m 2) for each T340 tangent to ôG at z and each N 0 orthogonal 
to 6G at z, where the Q;(z,é) are the characteristic polynomials of the B; 
and the z are the roots of P(z,7+zN) =0 with positive imaginary parts. 
Assume that A is properly elliptic in @ and is covered by the By, If V is 
defined to be the set of these u € C°(G@) which satisfy 


(5.1) Bu=0 on 1G, 1Sjsm/2, 


then it has been shown that hypotheses (a) and (b) of Section 3 are true 
(ef. [4, 7,8, 13, 14,16,19]). Thus we may conclude 


THEOREM 5.1. If A is properly elliptic in G and ts covered by the By, 
then the conclusions of Theorems 3.1-3.4 are true. 


We next consider bilinear integro-differential forms of order r,r = 1, 
[u,v] = f Sagar (2) Deu Dv da, 
ghia 


where the coefficients are in C° (G). Let Cy,---,C, be a normal set of 
boundary differential operators of order <r. By this we mean that their 
orders are distinct and that 6G is not characteristic to any of them at any 
point. Let U, be the set of those ve O” (Ẹ) which satisfy 


(5.2): Cu=0 on 64, 1SjSh, 


where A is a non-negative integer Sr. (If h=0,U,==0°(G)). The 
bilinear form [u,v] is said to be coercive on U, if 


(5.3) | «Ino? < const. (Re[u, u] + 1% Jos’) 
for all u€ U4. 
Since the set {C;} is normal of order < r, one has by integrating by parts 
r ren 
(5.4) [01 (4u,0) +3 (Fu On de 
j-i G 


(5.5) [uu] (wär) +3 f Cu Pfade, 
j=l’ 0G 
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where A and the F} and F? are differential operators and A’ is the formal 
adjoint of A (ef. [6]). i 
The following was proved by Agmon [1,3]. 


Lamma 5.1. If [u,v] is coercive over U, then A is of order 2r, is 
properly elliptic in G, and is covered by the operators O15: ©, Om Fun‘ , Fr 


Moreover, one easily verifies in this case that the {Fj} and {F/} are 
normal sets of operators of orders =r. If we let V be the set of those u € Un 
satisfying 
(5.6) Fu—=0 on dG, h<jsr, 
then V’ becomes the set of those u € U, which satisfy 
(5.7) Fju=0 on 0G, h<jse. 


(ef. [6,15]). Since the orders of the F; and F/ are Zr, we see that 
Yr G) == Vr (G) — Ur? (G) (cf. [18, Lemma 4.9]). 

If u€ N, then [u,v] —0 for all v€ U, by (5.4). Conversely, if we U» 
and [u,v] =0 for all ve Uy, then we N. Similarly, N’ turns out to be the 
set of those v € U, such that [u, v] —0 whenever u€ Ua. Thus we have 


_ THEOREM 5.2. Let [u,v] be a bilinear form which is coercive over Uy. 
Let N be the set of those u€ Uy which satisfy [u,v] —=0 for all ve Uy and 
N’ the set of those v € Uy which satisfy [u,v] =0 for all u€ Uy. Then every 
bounded linear functional Fu on U,"?(G)/N can be expressed in the form 


(5. 8) Fu= [u,v] ue Uy 
where v € Up”? (G)/N’. 
Necessary and sufficient conditions for [u,v] to be coercive on U, have 


been given by Agmon [1] (cf. also Schechter [14]). We consider here two 
simple cases. 


COROLLARY 6.1. Every bounded linear functional F on Hr#(G) can 
be represented by 


(5.9) Fu= > Diu Dev dz, 
lalar/ G 


where v € H? (G). 
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COROLLARY 5.2. Let H,'r(@) denote the closure of C,” (G) in H? (GY. 
Then for every bounded linear functional F on H,"?(G) there is a v € Ho? (G) 
such that (5.9) holds. 


Corollaries 5.1 and 5.2 were known to several authors, including Milgram, 
Lions, Magenes, Szeptycki, Fritz and the author (cf. [12]). 
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A CRITERION OF AN AMPLE SHEAF ON A PROJECTIVE 
SCHEME.* 


By Yossarxazu Naxat.* 


In his previous paper [2],? the author proved a criterion of an ample 
divisor è on a non-singular surface, i.e., a divisor X on a non-singular surface 
F is ample if and only if (X*)> 0 and X is arithmetically positive.* In this 
paper he will prove a generalization of this result to a projective scheme over 
a field. Originally the author intended to prove this generalization only for 
& non-singular variety of any dimension, say n. However, in the course of 
the proof it became necessary to treat the problem on a variety of dimension 
n—1 with singularities, and then on a scheme of dimension n— 2. This is 
the reason why he finally decided to treat the problem on a general projective 
scheme right from the beginning. 

The author wishes to express his heartfelt thanks to Professor O. Zariski 
and to D. Mumford. Without their encouragement and suggestions this work 
would not have been done. 

In this paper we shall make extensive use of notations, terminologies, 
and the results in Grothendieck’s book, “ Éléments de Géométrie Algébrique,” 
which will be cited as [G]. Most of them will be used freely without any 
further explanations, except some less fundamental notions. We hope the 
readers will not find much inconvenience in this way. 


1. Morphism associated with invertible sheaf. Let S be a graded 
ring which is a homomorphic image of a polynomial ring over an algebraically 
closed field k. Let us denote by 8, the set of elements of degrees > 0. 
Then the set of homogeneous prime ideals of $ not containing 9, with Zariski 
topology will be called a projective scheme over & and will often be denoted 


* Received August 15, 1962. 

1 This work is supported by the Air Force Office of Scientific Research and Develop- 
ment, under Contract No. AF49 (638) -494. 

* The numbers in the brackets refer to the bibliography at the end of the paper. 

° The meaning of the term “ample” is a little different from the classical usage 
(see the definition in Section 1). In his previous paper [2], the author used the term 
“non-degenerate divisor ” to express this property. 

“A divisor X on a non-singular surface F is called arithmetically positive if the 
Kroecker index (X-T) is always > 0 whenever T is a positive cycle. This nomenclature 
is due to O. Zariski. It was called (p)-divisor in [2]. 
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by Proj (8). Let X be such a scheme, and let £ be an invertible sheaf on X. 
Then T(X, £) is a finite dimensional vector space over k (III-2.2.2).° Let 
us set E =1(X, £>) and let € be the symmetric algebra of E over k (II-1.7.1). 
‘We shall denote as usual by ©, or Øx, the structure sheaf of X. Then € 
defines in a natural way a sheaf of Ö-module on X and we have an @-homo- 
morphism of graded algebras, 


pi E> L m Lon 
n=0 
From y we can define in a canonical way an open set G(y) of X and a 
morphism 
Yg: E(w) > Proj(€) =Y 


(II-§ 3). The morphism Te will be called the morphism associated with 
invertible sheaf £. 

We shall say that the sheaf £ is very ample if G(y) =X and y, gives 
an immersion of X onto Y and Æ is isomorphic to Ye (Ort). 

An invertible sheaf £ will be called ample if ¢®™ will become very 
ample for large m.° The morphism associated with an invertible sheaf £ is 
regular at ze X if and only if there exists a section s in T(X, £) such that 
s(z) 0, i.e, s(x) ¢ Ma. where m, is the maximal ideal of 6, (TI-3.7.4). 


THEOREM 1. Retaining the notations and assumptions as above, let Æ 
be an invertible sheaf satisfying the following conditions: (1) Ye is regular 
everywhere on X, (2) Yg (9) is a finite set for any y€ Y, (3) Yg (Ox(1)) 
=E. Then £ is an ample sheaf. 


Proof. Since any projective scheme is proper over k, y A is also. a proper 
morphism (II-5. 4.3). The condition (2) implies y ga finite morphism by 
(II-4.2.2). On the other hand Yg is dominate, hence y 38 surjective, because 
any morphism which is at the same time dominate and proper must be sur- 
jective. The final assertion now follows from (III-2.6.2) since Öy(1) is an 
ample sheaf on Y. Q.E.D. 


2. The reduction of the problem. 
Definition. Let £ be an invertible sheaf on a projective scheme X. We 
° This means the paragraph 2.2.2 of Chapter III of [@]. 


* This definition is different from the one given in [@], but they coincide as long 
as we treat projective scheme over a field (TI-4.@.9). 
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shall say that £ is arithmetically positive if for any reduced subscheme Y of 
positive dimension the Euler characteristic 


x( L88 Gy) -2 (—1)* dim Hr(X, £®-"@ Oy) 


increases indefinitely with m. 
Our final object is to prove the 


THEOREM 2. Let X be a projective scheme over a field k and let £ be 
an invertible sheaf on X. Then £ is arithmetically positive +f and only if 
£ is ample. 


In this section we shall make some reduction of the problem. In the 
first place, we shall state the following proposition, which can be seen imme- 
diately from the definition. 


Provosrtion 1. Let & be an arsthmetically positive sheaf on X and 
let Y be any closed subscheme of X. Then the invertible sheaf £’—= £® Oy 
is also an arithmetically positive sheaf on Y. 


Proposition 2. If Theorem 2 holds bŠ reduced schemes, then it also 
holds for general schemes. 


Proof. Let Xres be the reduced scheme associated with X. Then we 
have the injection 
j: Xvea—> Xx. 
Let £ be an arithmetically positive sheaf on X. Then, since 
(L) =L Ox. 


j*(£) is also an arithmetically positive sheaf on Xreg by Proposition 1. 
The final assertion now follows from (H-4. 5.14). Q.E.D. 


Proposition 3. If Theorem 2 holds for any irreducible reduced scheme, 
then tt also holds true for any reduced scheme. 


Proof. Let Xe (a =1,2,: - -,8) be irreducible components of a reduced 
scheme X. Let re be the injection of Xa into X. Let Y be the disjoint 
sum ]] X. of the schemes Xa (I-3.1), then we have a morphism 
. a 


r: YX 


which is the sum of the morphisms zg. As before we can see easily if & is 
arithmetically positive sheaf on X then wa*(¥) is also an arithmetically 
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positive sheaf on Xe, for any a, hence r*(£) is also arithmetically positive 
on Y. By definition of Y, »*($£) is ample if and only if va*(£) is ample 
on Xa for alla. Hence by assumption m*(£) is ample on Y. On the other 
hand, the morphism +: Y — X is surjective and finite as we can see easily 
from definition. The final assertion now follows from (III-2.6.2). Q.E.D. 


Thus Theorem 2 is reduced to prove the 


THEOREM 3. Assume that Theorem 2 holds true for any (n—1)- 
dimensional projective scheme over k. Then it will also hold true for any 
n-dimensional irreducible, reduced scheme. 


We shall prove Theorem 3 in Section 3 (n =1) and in Section 6 (n > 1). 


In the following, an irreducible, reduced scheme over k will simply be 
called an irreducible variety over k. 


3. Proof of Theorem 3 (the case n—1). Let X be a projective 
scheme over a field k and as before let Ø be the structure sheaf of X. Let X 
be the sheaf of total quotient ring of @ on X. We shall denote by Ö*, K*, 
respectively, the sheaves of multiplicative groups composed of unit elements 
of OÖ and K respectively.. Then we have an exact sequence of sheaves of 
groups 

(1) > 6* > K* > K*/6*- (1). 


From this we have an exact sequence of cohomology groups 


ò 
b> E(X, 4*) > P(X, k*/6*) — H (Z, 64) 
> E(X, K*) > 


As is well known, an invertible sheaf is represented, up to isomorphisms, by an 
element of cohomology group H+ (X, O+). An element of D = H°(X, K*/6*) 
defines in a canonical way an invertible sheaf, called a divisor, on X. The 
divisor defined by P—Im(y) form a subgroup of D, called the group of 
principal divisors. If X is an irreducible variety over k, the sheaf K* is a 
constant sheaf and hence H1(X,K*)—=0. Then the homomorphism 8 is 
surjective. It implies that any invertible sheaf is represented by a divisor 
on Z. ` 


Remark. More generally, H1(X,K*) —0 if X is a reduced projective 
scheme over k. If X is not a reduced scheme, it cannot be expected that we 
have H*(X, K*) —0. Nevertheless, the homomorphism § is surjective if X 
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is a projective scheme defined over an infinite field” (Cf. forthcoming 
paper [3].) 

A divisor D is, by definition, a subsheaf of X. We shall say that D 
is positive (or integral) at a point x€ X if D.C Ges. A divisor D is called 
a positive (or an integral) divisor if D is positive everywhere on X. The 
set of points z on X such that D, 6, will be called the support of 9, 
and will be denoted by Supp{®}. It is easily seen that a divisor D can be 
represented as a quotient of two integral divisors, though there is no canonical 
expression for it unless X is everywhere normal. - 

Now assume that X is one dimensional scheme over k and let @ be an 
integral divisor on X. Then we can define the notion of degree, deg @ in 
symbol, by . : 
dim, H°(X,6/@)— > length (6./.). 

æ € Supp (A) 


Let D be an arbitrary divisor and let D = A & 8 be a representation of D 
as a quotient of two integral divisors. Then the degree of D is defined by 


deg D = deg Q — deg B. 
If f and g are two non-zero divisors of @ we have 


length (6/(fg)) = length (0/(f)) + length(6/(g)). 
From this we see easily that the definition of deg D does not depend on any 
particular representation as a quotient of integral divisors. 
Let Æ be a divisor on a projective scheme over k. We define x( £) by 
X(L*) = & (—1)? dim, H’ (X, £*). 
p=0 

This is a well-defined integer, since these cohomology groups are of finite 
dimensional over k (III-2.2.2).' 


PROPOSITION 4 Let X be a one-dimensional projectwe scheme over a 
field k and let E be a divisor on X. Then we have 


x(£7) = deg(£) +x(6) 


The proof is quite similar to the proof given in [4], where X is an 
irreducible curve, and it will be omitted. 


COROLLARY. The degree of principal divisor is 0. 


- Proof. Let ¢ be a section of A(X, H*). Then the sheaf Gt is iso- 
morphic to @ and hence x(6) = x(@t). 


7 This will be proved in a more general situation in [3]. 
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In the rest of this paragraph, we shall assume X is an irreducible variety 
over k. 


PROPOSITION 5. Let D be a divisor of positive degree on X, then 
H(X, DO") ma {0} if m is big enough. 


Proof. There exists a divisor D, linearly equivalent to D such that 
any point in Supp {D,} is simple on X. Since H(X, DS) = H(X, DB), 
it suffices to prove under the assumption that any point in Supp {D} is simple 
on X. This is proved in [4]. 


PROPOSITION 6. Let D be a divisor of positive degree on X. Then for 
large m the morphism ym associated with the divisor DE” is everywhere 
regular on X. 


Proof. Let x be an arbitrary point of X algebraic over k and we shall 
show that there exists an integer m such that ym is regular at z. Since the 
domain of regularity is an open subset of X it suffices for the proof of the 
proposition. Without loss of generality we can assume that z is not in the 
support of D, ie, Da= O.. Let f (540) be an arbitrary non-unit element 
of ©, and let f be the divisor defined by fs = Oof and fy == 6, if y4x. We 
shall consider an exact sequence of sheaves 


0> DO @ f> DER > DO-™@ (/f) > 0. 
Since (6/f)y——0 if yAax and D= 62, DB"@(6/f) =—6./(f). On 


account of Proposition 5 we have the exact sequence 
H(X, DE) > 6./(f) > 0. 


Let s be a section of H°(X, €@*) such that s,==1 mod (f). Then se is a 
unit of s and ym is regular at z, completing the proof. Q. E. D. 


Proof of Theorem 3. In the case where dim X == 1, the condition (2) 
of Theorem 1 is trivial. As to condition (3), we proceed as follows. Without 
loss of generality, we can assume that D is a positive divisor. Then 1 is a 
section of H°(X,D®™). By condition (1) for any point z on X, there 
exists a section s in H°(X¥,D®@™) such that s(z) 340. Hence we have 
DE" Oas. Since s is in the affine coordinate ring of Y=ym(X), it 
implies the condition (3). 


Thus all conditions in Theorem 1 are satisfied for a divisor D®-m for 
large m, hence Theorem 3 is proved in the case where n == 1. Q. E. D. 


20 YOSHIKAZU NAKAI. 


‘4, ‚Fundamental lemmas on ample. sheaves. 


Proposition Y. Let £ be an ample sheaf on a projective scheme X 
over a field k. Then for any coherent sheaf +P on X we have ee F2 E 
= = {0}, for a sufficiently large m. 


This is the immediate consequence of the definition of ample sheaf and 
the generalization of Serre’s results on projective schemes (IIT- 2.2.2). 


Proposition 8. Let Æ be an ample sheaf on a projective scheme X 
and let Y be any closed subscheme of X. Then £® 6y is also an ample 
sheaf on Y. 


Proof. Let 7 be the injection fax. Then £® TER (£) and 
LS O Oy — jo( LS"). Hence if £8- is very ample, £2" ® Gy is also 
very ample by (II-4.4.10). Q.E.D. 


Let X m (8) be a projective schema over a field & and let 
I= a Ku ,X,]/U where X is a homogeneous ideal of k[X]. Let 


Y = N ©, be a normal decomposition of 2. Now assume that the’ radical 
van. of Qs is the irrelevant ideal (Xo Xpt  ',Xr). In this case let us. 


t 
put W=N Q; and let §,—%[Xo, Xi," -°,Xr]/Ws. We shall show that X 
i=1 


_ and proj (81) =X, are homeomorphic. Let X be the kernel of the homo- 
` morphism ¢: S—>8,ı. Then we have an exact sequence 


0>- S— N>. 


It is not difficult to see that X is composed of elements x such that 
28,"—0 for some n. Hence any prime ideal p in proj (8) must contain 
the ideal X and there is a bijection from X onto X,. The coincidence of the 
structure sheaves can be seen immediately and thus X and X, are homeo- 
morphic. The above consideration shows that any projective scheme over a 
field k has a homogeneous coordinate ring § such that any generator of 8 
contains at least. one non-zero divisor. This implies, among others, the 
coherent sheaf 6x(—1) == Öx(1)" can be represented by a divisor 9 called 
a hyperplane divisor of X. 

PROPOSITION 9. Let £ be an ample sheaf and let 9 be a hyperplane 
divisor on X. Then there exists an integer N such that ` 


H’ (X, L9 Q YS) — {0} 
af m= N, 820 and p21. 
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Proof. We shall.use the induction on the dimension n of X. Let H be 
a closed subscheme defined by a hyperplane divisor. Then we have an exact 
sequence of sheaves. . i 


0> LEMO Y > LIMO YD -> LED HTD Ox > 0. 


Since £8 Oa is ample on H by Proposition 8, there exists an integer N, 
such that l 


H" (X, L9” 8 HS8 Oa) = H’ (H, L: ng HS) = {0} 
for m= N., s20, and p21- 
by the induction assumption, where L, =L On, Hi=HOGxq. Let Na 
be an integer such that H° (X, £9) — {0} whenever m =N, and p21. 
The integer N = Max (N, Na) will satisfy the requirement of the proposition. 
In fact, if we fix an integer m = N, we have the exact sequence of cohomology 
groups 
He (X, LE- @ YS) —> He (X, LF" @ HS) 50. 


for p= 1. Beginning from s— 1, we see immediately that 
He(X, ee = {0} 
for any s Z 0 and p=1. ; Q. E. D. 


The similar device used above leads to the following 


Proposition 10. Let £, H be as in Proposition 8, let D be an arbitrary 
invertible sheaf on X. Then there- exists an integer N such that 


H?(X, L&D HS- D) — {0} 
if mZ N, 820, and p21. 


5. Proof of Theorem 3 (the case n > 1). In this paragraph we shall 
assume that X is an irreducible variety over k embedded in a projective space. 
Let £ be an arithmetically positive divisor on X. We shall show £ is an 
ample divisor under the induction assumption in Theorem 3. For the sake 
of simplicity we shall denote by AP(m) the dimension (over k) of the 
cohomology group Hr(X, ®-™). The proof will be divided in several steps. 
The assertion involving the integer m is claimed to hold only if m is sufficiently 
large, though sometimes it may not be mentioned explicitly. 


(I) ae he(m) = 0 for p=2. 
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Proof. Let Y be a hyperplane divisor. Then we have an exact sequence 

of coherent sheaves. 
0> LOD NH > GOW AT: > LOUD Ox > 0. 
“where H is the hyperplane section of X defined by a hyperplane divisor X. 

From this we have an exact sequence of cohomology groups 

HH, £2" OU @ Oy) H(X, LO" @ HS) 

-> He(X, LS” OA) > He (H, L8- YS Gz). 

The two extreme terms vanish by Proposition 10 if m is big enough and p Z 2. 
Hence we have an equality 


dim H’ (X, LO" @ YD-1) — dim H? (X, LF" @ S+) 
for any s È= 0, p= 2, if m is big enough. For a fixed integer m we know 
that H’ (X, 97 @ HS-*) — {0} if s is big enough, by (III-2.2.2), hence 
He (X, LO") — {0} for any p= 2. 
The following proposition will be proved by the same device. 
(I) Let D be‘an arbitrary divisor on X. Then Hr(X, 8" 9D) 
— {0} if p= 2. 


(II) Assume moreover that £ is a positive divisor. Then h*(m) is a 
constant after some large integer m. 


Proof. Since £ is positive we have an exact sequence 
0—> gem > Lm > OO Or 0, 
where L is the closed subscheme defined by the sheaf £. Since (LSO Or) 
= 0 for large m and p21, by induction assumption, we see that h! (m— 1) 
Z= h (m) after a certain integer. The inequality cannot hold indefinitely. 
(IIT) Under the same assumption as in (II), let €—=DO@D’ be a 
decomposition of £ as a product of two positive divisors D and D’. Then 
h (LSO D) mc hi (m). 
Proof. From the inclusion relation 


Kor Cc Lmt ® Di Gon QDE Pom 


and hi(£2™@ G/D) —0, (L898 De H/D) =0 by induction 
assumption, we get easily the relations 
h (m—1) Sh} (LP D) mht (L&O D) > h(n). 


: Q. E.D. 
The inequality combined with (II), we get the assertion. 
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COROLLARY. Retaining the notations and assumptions as in (III), we 
have an exact sequence f 


0> H(X, 8*8 D) > H(X, LO") > H(X, LF"@ G/D) 30. 


(IV) Let D be an arbitrary divisor on X. Then H°(X, £®-"@D) 
# {0}. 


By assumption, 
x(X, £2" D) = dim H? (X, 9 "@ D) — dim H! (X, LF" @ D) 


increases infinity as m increases, since he (£89 ® D) —0 for p=2 In 
particular, H? (X, 9" ® D) is not zero. 


(V) The morphism ym associated to the divisor £8" is regular every- 
where on X. 


Proof. It is sufficient to show that ym is regular at every point v 
algebraic over k. Since a divisor £ is ample if and only if £8" is ample 
for some m (II-4.6.9), we can assume without loss of generality that £ is 
a positive divisor. In this case 1 is a section of H°(X, £®-') and hence any 
point outside the support of ¥ is contained in the domain of regularity of 
the morphism ym. Let m be a large integer such that the sequence 


(0) > B° (X, 28") > H° (X, LO") > (X, LE" @ 0/£) 
> (0) 


is exact. Let L be the closed subscheme defined by the sheaf £. Since 
A(X, LE" @ G/L) = H° (L, Le") where = 286, and Ẹ is an ample 
sheaf on L by induction assumption, there exists a section 5 in H°(L, £9") 
such that 5(Z) 540 for a given in L, if m is large enough. Let s be a 
section of H°(X, £9") whose image in H°(L, 8) is precisely 5. Then 
-it is not difficult to see that s(£) 540, proving ym is regular also at @. 


(VI) ym*(Oy(1)) = L9. 


The similar device used in Section 3 can be applied to this case. Hence 
the proof is omitted. 


(VII) Let y be a point of Y rational over & and assume that 
£=yı*(Ör(1). Then y (y) contains only a finite number of points. 
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Proof. Let # be a hyperplane divisor of Y not containing y. Since 
F= Gy(1), we have y*(FO™) = 9 (y == yı). Assume that y*(y) 
contains infinitely many points, then it implies y(y) is a closed subscheme 
of X of positive dimension. We shall denote this subscheme by D. "The 
structure sheaf @p is given by On = Ox®o,(Oyr/M) where M is the 
defining sheaf of the closed point y. Since 


£2" We, On = (FF" Wo, Gr) So,(Gx/M) 

and F, = Oy, we have ee 
Op if zé€D 
0 ife¢D 
and x(S" @e, Ön) = const. for any m. 

This contradicts the assumption that £ is an arithmetically positive 
divisor. 

(VIII) If. the morphism f: XY satisfies the condition of (VII) 


for any rational point over k, then f(y) is also a finite set for any point 
y of Y. 

Proof. By (IHI-4.4.1) the set of points ze X, such that f4(f(#)) is 
a finite set forms an open subset X’ of X. Hence if X 4X there must exist 
a k rational point z in X— X’ such that f*(f(z)) is not a finite set, con- 
tradicting the assumption. Q. E. D. 


The assertion (VIIL) uoki the proof of Theorem 3 on account, of 
Theorem 1. 


(L980, Ön) = 


6. Ample divisors on a non-singular variety. In this paragraph we 
shall give an alternative condition for a divisor to be arithmetically positive. 
Let V” be a non-singular variety of dimension n in a projective space and 
let @,(V) be the additive group of cycles of codimension r on V. Let 
©, (V) be the subgroup of G,(V) consisting of cycles which are numerically 
equivalent to zero. Let ©,* (V) —@G,(V)/G,°(V). Then the direct sum 
G*(V) — 2 G-"(V) (G,*(V) = 0 if r> 7) will be a graded ring in which 
the multiplication is defined by the intersection product of cycles on V. Let 
z be a homogeneous element of &*(V). We shall say z is numerically positive 
if the class z contains a positive cycle. 

Since G,(V) is isomorphic to the ring of rational integers Z it is 
meaningful to say that an element of degree n in ©*(V) is positive, negative, 
OT zero. 


CRITERION OF AMPLE SHEAF. -> - 25 


THEOREM 4. Let X be a divisor on a non-singular variety V and let z 
be a class of X in &*(V). Assume that (aty)>0 for any numerically 
positive element y of degree n—r (r=1,:::,n). Then X is an ample 
divisor, and vice versa. 


Proof. On a non-singular variety V any reduced scheme of dimension r 
corresponds, in a 1-1 way, to a cycle Y of dimension r whose reduced expression 
is the sum of irreducible varieties with coefficients 1. (We shall call such a 
cycle a reduced cycle). Hence to prove the theorem it suffices to prove the 


following 

PROPOSITION 11. Let X, V be as in Theorem 4 and let Y be a reduced 
cycle of dimension r. Let £ be the locally free sheaf on V defined by X. 
Then x(£L2"™@ Oy) is a polynomial of degree r in m whose coefficient of 
highest term is given by (z’y)/r. 

Proof. We shall prove by using double induction on the dimension n 
of V and dimension r of Y. 

The case n—1 is contained in the case r—1. 

In the case where r= 1, it is proved in Proposition 4. 


Let D and # be non-singular subvarieties of codimension 1 such that 
X+D-E and such that the cycles Y-D, Y-E are also reduced cycles. 
Moreover, we can assume without loss of generalities every component of X, 
D, and E does not contain any component of Y. We shall denote by £, D 
and € the invertible sheaves defined by X, D, and F, respectively. We shall 
consider exact sequences 


0> L&O D O Gy > £2-"@ Gy > LHE 0,9 Gy 30 
0> Lem RES 6, > LSR Gy 
> LO- Q Or S Ös> 0. 


Since £9" @ D — LIM QE, we get 
` x( £9" @ Gy) —x(L"®@ Gy) 
=X(£L£O"™"* Gr © Oa) —x (LEI Gy @ Gp). 


The right-hand side is, by induction assumption, a polynomial in m of degree 
(r— 1) and the coefficient of mt is given by 


Large) — ya) Ye [= EW, 
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where e and d denote the classes of D and E in G*(V) respectively. From 
this we can draw easily the conclusion in a routine way. Q. E. D. 


HIROSHIMA UNIVERSITY AND HARVARD UNIVERSITY. 
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PERIODIC SOLUTIONS OF THE RESTRICTED THREE BODY 
PROBLEM REPRESENTING ANALYTIC CONTINUATIONS 
OF KEPLERIAN ELLIPTIC MOTIONS.* 


By Riowarp F. ARENSTORF. 


Introduction. The equations of motion for the plane Restricted Three 
Body Problem can be written in the form 


a” 4 ie! —a 
(1) =— (1-2) (+ p)| € +a |" — u(t +u 1)| z +u 1], 
(= d/dt) 


where x= q, + iz, is the complex position vector of the infinitesimal body 
referred to a co-system rotating with angular velocity 1 about the center 
of gravity of the two attracting bodies of masses 1 — p and u (OSa S1) 
as origin. 

When u 0, the solutions of (1) are well known and can be represented 
as z(t) ==ettz(t), where the complex position vector z(t) describes the 
Keplerian motion: i.e. a solution of z”——z|z|-*. Under suitable initial 
conditions this latter motion will be periodic, for instance with 


(2) 2(0) a(t +e), 70) =ict/2(0), Malle), 
(a>0,0<e<1) 


z(t) moves along an ellipse with major half axis a and eccentricity «e, having 
z= 0 as focus and 2(0) at maximum distance from 0. Its sidereal period is 
To = 2r |a? |. The corresponding x(t) will be periodic, iff. 7’, is commen- 
surable with 2r, or ał = m/k, where k and m are relatively prime integers, 
m>0 and & is chosen positive resp. negative, if z(¢) is direct resp. retro- 
grade;-l.e., ignk—signc*. The synodical period on the rotating ellipse 
then is T* — arm and the curve s= q(t), (0St=7*) is closed after k— m 
positive revolutions around the origin. We denote this solution of (1) with 
p= 0 from now on by z*(t) and obtain from (2) for its initial values 


(3) + —=a(l+e), de*/dt—i(c*—x**)/c* at t=0. 


We shall show the existence of periodic solutions z(t) of (1) for small a > 0, 
which are near the generating solutions «*(t) belonging to arbitrary integers 


* Received September 13, 1962. 
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k,m <0 and properly restricted e: Namely, there are for fixed a == (m/k)?!® 
at most finitely many ein 0 < e< 1 with e= V. (1— q>?) or with 2*(¢) =1 
at least once. in 0<St=T*. For every closed «interval J containing none 
of these exceptional values there exists a positive u? such. that (1) possesses 
for every fixed pin OS p < p* S1 a family of periodic ‘solutions depending 
analytically upon the parameter « in J. These solutions are holomorphic also 
in p and transfer into x*(t) for »—0. Their synodical periods and Jacobi- 
constants are holomorphic in e and „ and depend both actually upon p. 

This result includes especially the existence of the periodic solutions of 
the so-called second kind for the Restricted Three Body Problem. Their 
existence had been claimed with supposed proofs by H. Poincaré [6], K 
Schwarzschild [6] and C. L. Charlier [2], whose invalidity was shown by P. 
Staeckel [8] and A. Wintner [9], [10], however. In these attempts the . 
continuation method of Poincaré wasemployed in an isoperiodic or an iso- 
energetic manner. We too, apply this continuation method, but replace the 
general (because of the existence of the Jacobi integral unsymmetric) periodicity 
condition of Poincaré by a more special one, which is based on the symmetry 
of the dynamical problem (1), and has been used by G. D. Birkhoff [1] already. 
This condition is not only simpler and more natural, it also points out and 
reduces the redundancy in the classical periodicity conditions, which caused 
the critical functional determinants to vanish; see A. Wintner [9] and C. L. 
Siegel [7]. Otherwise, we achieve our goal by employing appropriate variables, 
which render the dependence of the Keplerian motion upon its initial values 
in a most simple form. 

In this regard, it is to be mentioned that G. D. Birkhoff [1] showed 
a.o. the existence of periodic solutions of (1) for small u, which close in the 
rotating co-system only after sufficiently many revolutions about the mass 
1— p, if their Jacobi constant determines a simple closed zero-velocity curve 
containing the orbits in its interior. B. O. Koopman [3] established the 
analogon for the exterior case of a zero-velocity curve with forbidden bounded 
interior. More recently J. Moser [4] showed the existence of periodic solu- 
tions of (1) for small p, which close after many revolutions and are near 
solutions of the existing first kind of Poincaré (generated from circular. 
motions for »=0). AIl these solutions correspond for »==0 to periodic 
motions along rotating ellipses with rational ał. It is presently not known 
if these solutions for » > 0 coincide with certain of our above solutions x(t) 
generated from x*(¢) with large |k—m| and suitable, small «> 0. 

Finally we remark that several of these solutions for different m/ k, whose 
existence is shown here for small u > 0, have been numerically calculated by 
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us for incréasing p on high speed electronic computers. They are particularly 
of interest, when a(1—e) <8 and 1 <a(1-+e) <1+8 with small 53> 0, 
since then they pass repeatedly near both masses of the Restricted Three Body 
Problem. The calculations indicate their existence for values of p at least 
as large as that for the case 1— p/p equal to mass of the Earth/mass of the 
Moon. Thus, their practical significance for -astronautics is apparent. This 
also was one of the incentives for the investigation presented here. 


Existence Proof. Let z(t) be a solution of (1), which is holomorphic 
on an interval OS!ST, T>0; i.e. free of collisions. If (with a bar 
denoting the conjugate complex nuinber) 


(4) s(4T) =2(4T), vn) =— 7 ($T), 

then the function &(T—-t) of t is identical with z(t), since it satisfies (1) 

also and the two functions and their first derivatives coincide respectively 

at ae Thn implies, if additionally , 

(5) 20-20), 70-20), 

that z(T) = (0), (T) = (0), so that z(t) will be periodic with period T, 

since (1) is, autonomous. Then the closed curve z=z{t), ((StST) is 

symmetric over the z,-axis, since 2(—t) Z(t). Especially z*(t) satisfies 

(5) by (3), and also (4) with T—T*—|k|T,, since as a consequence of 

(2) 2(k-T./2) is real and 7’ (k: T,/2) is pure imaginary for every integer k. 
We introduce new real variables F, H, U, V instead of z == q, + ix, and 

y = 7 + ie =y, + iy: by 


(a) E adgas Hye +y) rio r= (zè +t), 

' Tan a: V = 2/1 + cy, C= Ey —Tafı. 
The functional determinant of this transformation is D = — (2H + 3c) c /r®. 
Now c and H are first integrals of (1) for p= 0, since with z(t) —e'z(t) 
then 


c == Im žy == Im Zz = const. of area, 
H+e—4|2 |?—|2|-*—const. of energy, 


_ as well known for the Keplerian motion. By (2) then - 


cm c*, H=— c* — 1/2a, le >0 on a*(t), 
Thus 
(7) D= (0 —1/a) 0/12 on z*(t), ` 


and the oaa (6) is analytic and locally 1-to-1 in a neighbor- 
hood of every point on the trajectory 2*(t),y*(t) — da* (t) /dt + iz*(2), 


30 RICHARD F. ARENSTORF. 


(0StST*) if D0 or ac*£1. This holds for 0 <e<1 always, when 
@ 1 or when ez V (1—a*) for a > 1, c* > 0, and this assumption will be 
made from here on. 

Now (6) transforms (1) in case p == 0 into 


Pee eg nen 


(8) H! == 0, U’ = V, V m — U, 


since from (6) c==r(1— U cos F— F sin F')/c. If we denote initial values 
by the corresponding small letter, (8) can be integrated up to 


9 ee 
(9) EF + 1 =c (1—u cos(F +t) —vsin(F+#))* 


This and (6) yield 
(10) uw? + v? = U2 4 V2 —1—2c/r + 68 (yy? + yn?) me 1 + he? +20, 


so that c depends upon the initial values h, u, v. Substituting for these the 
special values . 
(11) f*=0, ht — È —1/2a, ur evt 0 


derived from (3) and (6) gives c = c* and by (9) the original solution z* (t), 
but now represented in the new variables. 
In general (6) transforms (1) into a system 


(12) E == ga, E =g, U’ — 9s, vg, 


where the ga = g„(F, H,U, V, p) are holomorphic functions of all variables 
in a neighborhood of the special solution determined by (9), (11) and for 
sufficiently small p= 0, if z*(t) is free of collisions for a„—=0. Given 
a= (m/k)?!®, such a collision, i.e. 2*(¢) = 1 for some t in 0S:!=T*, can 
happen only for finitely many values of ein 0<e<1. We return to this 
condition later and assume here only that these e are omitted. Then, according 
to Poincaré’s extension of Cauchy’s existence theorem for ordinary differential 
equations (for a modern proof see C. L. Siegel [7]) the solutions of (12) are 
holomorphic functions of £,f,h,u,v, and a for OSt 27", say, and suff- 
ciently small | f|-+ |k—h*|+ju—e|+ |v]+y, »=0, using (11). For 
a0 (12) becomes (8). 

We consider now the solutions of (12) with small »>0 and initial 
values near (11). These solutions can be assumed remaining near the original 
solution given by (9), (11) for 0=:=S2T*, so that especially (6) is 
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applicable. In order that such a solution will be periodic in the former 
coordinates -z,, Te with period T > 0, it is sufficient by (4), (5), (6) that 


FAT, f, h, u,v, ) =r(k— m), f=0, 
ge) a Een) —|, v=0, 


since for the considered solutions of (12) c remains near c*, and therefore 
the assumption c40 at t= 4T can be made, if T <2T*. These equations 
are actually satified for the original solution z*(t) and »—0, or with (11) 
for 
(14) T = Tim, [= ff, h=h*, u—u*, vr, p= 0, 
since 

arc z? (3T*) = arc[e rs (| k|T,/2) ] = arc[e mre] = (k— m)r 





by (2). Hence (13) can be satisfied for small » > 0 and initial values near 
(14), if for instance the functional determinant 


(15) D* == FV, —F,V;%0 for i=$T at (14). 


By the holomorphy it suffices putting »—0 in F, V first and then calculate 
the partial derivatives, which therefore can be found from (9) and (10). 
Denoting partial derivatives by a corresponding index, (9) gives V, = 0 and 
Y;=— U, hence with (11) and (14) 


(16) D* == e cos mr : Fy(mr,0,h*,60), (p=0). 
We put 
(17) p =t + F(t, 0, h,e 0) =¢(t, h). 


Then it follows from (9) that is uniquely determined by inversion of the 
integral 


$ 
(18) t= f (1—ecosy) dp. . 
9 
The value of c here is determined by e = 1 + 2hc? + 2c* from (10). This 
implies 
(19) Cy = — c (2h + 8c). 


Differentiating (18) partially with respect to h gives 


Ci F 
0 = 3c!c, Í, (1 — ecos y)dy + c (1— e cos p) "br, 
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hence with (19) 


¢* 
(20) galma, ht) =3(1— ecos *)*(2h* 430%)3 f "(1 —c cosy) tay, 
where ¢*== (m7, h*). But 


Rct? IK — cosy) dy = + To = 2?rm/k 
® 


for the period on the original Keplerian ellipse as well known, thus by (18) 
d*— kr and by (16), (17), (20) finally 


(21) D* = 3.(— 1)" (1— e(—1)*)’mm/ (0 — at) CH 40, 
so that (15) actually holds, since 0 < e < 1 and c* 4a™ as required for (7). 


From the implicit function theorem it follows now that (13) can be 
“ solved for T and h in a neighborhood of (14), and thet T—T* and h—h* 
‘for uu =e result as power series in p without constant terms having 
positive radii of convergence. This implies especially O<T<2T* for 
small u > 0 as assumed before, so that by (18) the existence of the desired 
periodic solutions z(t) is now actually shown. Their initial values 2(0), 
x(0) are determined by (6) and 


(22) f==0, h=h(p,€), ume, v= 0 


as functions of u, e and a. 

Since for any given a == (m/k)*/* the foregoing is valid as long as e is 
not one of the previously excepted values, it is a consequence of the local 
existence theorem for implicit functions and of the covering theorem that 
T=T(me) and h= h(u, <) are holomorphic functions of » and e on every 
closed e-interval not containing one of the exceptional values and on 0p < p* 
with corresponding sufficiently small u*> 0. The solutions of (12) belonging 
to (22) are holomorphic functions of their initial values and thus the corres- 
ponding periodic solutions z(t) are holomorphic on OS t & T and in e and p 
as stated in the introduction. 

If one introduces in the transformation (6) instead of the variable Æ the 
Jacobi integral 


J=} |y | — o (1— p) |s +a] — u| e+2—-1]%, 


our whole consideration can be carried through in the same way. Thus also 
J =J (p, €) is a holomorphic function of both variables, which clearly follows 
from 


Toh + | zo |7 — (1—p)| tota |t — nu ]| eo +a— 1|", zo=2(0) 
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"and the foregoing too. In (13) then h is to be replaced by the initial value 
j of J, but J=j now. It is then of interest to consider besides (15) the 
other two functional determinants suggested by (13); namely, 


D,* = FLV,— FV; and D;* = Fj Vy — FV; 


for t == $T at (14), where j = h®. Since here Vy = — sin mr == 0, Vj = 0 and 
V,=—ZT by (9), it follows D,* —0 and D,* «cos mr Fu( mr, 0, hë, €, 0). 
Putting ; 
` y =t + F(t, 0, h*;u, 0) = y(t, u), 


it follows from (9) y= c (1— u cos y)? and thus similar as from (18) for 
$ now y(mr, u) == kr identically in 0<u<1. Hence also D,*—0. Thus 
solvability of (13) with respect to T, u for fixed j = h*, or with respect to j, u 
for fixed T =— T* remains at least doubtful, if at all possible. In fact, A. 
Wintner [9] has shown that for sufficiently small «> 0 isoperiodie solutions — 
do not exist. 

It is interesting to note that the treatment presented here is also effec- 
tive for the periodic solutions of the first kind. Im this case e==0, and 
af ox: + To/2r = w> can be taken arbitrary, especially not rational, with the 
exceptions w»54—1,1 and w41 + m", m natural. Then it follows D,* +0, 
D? >40, but D*=0 in (15), which is the reverse of our present situation 
for e>0. Of course, an existence proof for the solutions of the first kind 
is long known. 

Finally we consider the restrictions placed upon e for our existence proof. 
These are ` 

0<e<1, e V(1—a?) for a>1, c*>0, 
(23) z*(t) Alin 0 StS mr for a= (m/k). 


The first of them is equivalent to ac? 1 or 2h* + 3c*=40 and was required 
for (7) and (21). The dynamical meaning of this condition becomes clear, 
when the sidereal frequency o= 2r/T, == |a| is used instead of a to 
characterize the generating elliptic motion together with its eccentricity. 
Since here a—=0, H coincides with the Jacobi-integral J, and then (19) 
shows that the Jacobi-constant j—=-h of the generating motion z*(t), for 
which now : 


= — 0 — 1/20 = — Joa? — sign at (1—#), (o> 0) 


has for given « as function of c* or w a relative extremum (absolute maximum) 
for ac* —1 or o == V (1—e), in the direct case only. The inverse function 
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and thus the sidereal period T, then are not determined uniquely as functions 
of the Jacobi-constant and the eccentrieity in a neighborhood of the branch 
points (= — (1—)*/*-3/2,«). The dynamical meaning of (23) is to 
exclude collisions with the perturbing body. 

We shall show that for fixed k and m (23) excludes at most finitely 
many values of e. To see this, we represent the Keplerian motion z == g(t) 
= ettet (t) with the help of the eccentric anomaly w, namely with (2) in 
the well-known form 


: z2=a(etcoswtty (1— e) sin w), 
G oa. 


If (23) does not hold, then with appropriate e between 0 and 1 
(25) a==ett,  |z|=a(1+ecosw)=1 


for some w between 0 and kr inclusively, using (24). The last equation 
implies |1—1/a|Se<1, thus a>4. Hence (23) holds always, when 
2451. If a1, then by (25) cosw==0 and thus with (24) 


e = 008 É = cos (w + e) ==— Eine, 


which is impossible for 0 <e < 1. Let now a > 4, a41 and (25) be satisfied 
for appropriate e and w. Then with —A--—-=1—1/a and (24) 


ecos w = Á x40, a(e-+ cosw) = cost, 
(26) a(cos w + A/cos w) — cos[ at (w + Atg w) ] =0. 


Since | A |Se<1 and with w* from cos w* = |A |, OS w* < 2/2, we have 
for suitable n 
(27) © |w—nr|<w*, n= integer, |n|=|k|. 


Now the left side in (26) is a holomorphie function of w in (27) and even 
in every of the finitely many closed circles | w—nr | Sw”. Thus it has at 
most finitely many zeros in (27), and these correspond to at most finitely 
many e= A/cosw satisfying (25). This proves our statement about (23). 

` One can easily see that our whole derivation remains valid, if we begin 
in (2) with 2(0)—a(1—e) at minimum distance from 0. This merely 
replaces e by —« in the subsequent equations. But it leads to new periodic 
solutions of (1) for small u, which are actually different from the previous 
ones, even when considering solution curves only, if k—m is odd. All of 
our periodic solution curves are symmetric over the z,-axis, and they can be 
readily visualized in the rotating co-system. 
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TRANSITIVITY IN THE SPINORIAL KERNEL AND. THE COM- 
MUTATOR SUBGROUP OF THE ORTHOGONAL GROUP.* 


By Barta POLLAK. 


Let V be a finite-dimensional vector space over a (commutative) field 
K of characteristic +2 upon which is defined a quadratic form whose asso- 
ciated bilinear form is non-degenerate; that is, V is a non-singular quadratic 
space. (For the theory of quadratic spaces, see [1], [3], or [4].) Let O(V) 
denote the orthogonal group of V, O+(V) the subgroup of elements having 
determinant +1, O’(V) the subgroup of O*(V) consisting of the elements 
of spinor norm 1, and Q(V) the commutator subgroup of O(V). If AE V 
and !(A) denotes the set of all vectors in V having the same length as A, 
then, by Witts Theorem, O(V) operates transitively on 1(A). If H is a 
subgroup of O(V), H partitions 1(4) into a certain number n(H) of transi- 
tivity classes. It is easy to compute n(O+(V)). After certain preliminary 
results (§§ 1-2), we give (in 83) an expression for n(O’(V)) in terms of 
spinor norms. If K is a field for which a representation theory for quadratic 
forms is known (i.e., finite fields, real numbers, local fields, global fields) we 
obtain (§§ 4-7) an explicit formula for n(O’(V)). Under a special assump- 
tion we are able to express n(Q(V)) as n(O’(V))(O’'(V):Q(V)) which 
enables us to give an explicit formula for n(Q(V)) for the fields already 
mentioned. As a corollary we obtain necessary and sufficient conditions for 
O’(V) and Q(V) to operate transitively on 1(A). 

For our convenience we adopt the notation of [1]. Thus if U is a sub- 
space of V we denote its orthogonal complement by U*, its dual space by U”. 
AB denotes the scalar product of 4, B€ V and 4°=AA denotes the length 
of A. The subspace spanned by vectors X,,---,Xm will be denoted 
<X1,- + -+,Xm>. If <A> is non-singular, we denote the symmetry with respect 
to the hyperplane <A>* by ra. If o€ O(V) we denote its spinor norm by 
(o). Finally, d(V) denotes the discriminant of V. 


1. Group-theoretic preliminaries. Let 9 be a set and suppose @ is a 
group that acts transitively on S. For ze g, let G, be the stability group 
of æ. It is obvious that the points of S are in one-one correspondence with 
the elements of the coset space @/G,. Now let H be a normal subgroup of G. 
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If z,y € 8 call c=ymodH if there exists o€ H such that o(z)=y. This 
is an equivalence relation and partitions S into equivalence classes. Denote 
the set of equivalence classes by SmodH. Then G/H operates transitively 
on mod H in an obvious manner and if #(T) denotes the cardinality of the 
set T, we have 


Proposition 1. #(SmodH) = (G/B: G,H/H) for any ses. 


Proof. G,H/H is clearly the stability group of the equivalence class of 
SmodH that contains z. 


Proposition 2. Suppose N is a normal subgroup of G and NCH. 
Then #(S mod N) = (G/H: G,H/H)(H/N: H,N/N) for any c€ 8. 


Proof. This is nothing but a well-known index reduction principle 
applied to the canonical map of G/N onto G/H. (See [2], Lemma on 
p. 140.) 


Remark 1. NOH implies SmodN is a refinement of the partition 
SmodH. H/N operates transitively on an element of 9 mod H and if H (s) 
denotes that element of SmodH containing v, then Proposition 2 could be 
restated (and reproved) as _ 


#(8modN) = #(S mod H)#(H (z) mod N). 
In the sequel we shall apply these propositions when § ==set of vectors 
of a given length and G==O(V). 


2. The subgroup O4(P). Set O4(V) = {c € O(V)|o(A) =A} and 
Ost (V) =04(V) NO*(V). I A? 0 then, trivially, N œ 0(<AS*). 
If A is non-zero and isotropic (4? = 0) we have 


THEOREM 1. Let V be a non-singular quadratic space of dimension = 3, 
and suppose A is a non-zero isotropic vector. We may write CA = <A> LW 
with W non-singular. Then there exists a natural mapping f:04(V) > O(W) 
such that 

1) fis an epimorphism 

2) Kerf =W 

3) deto == detf (o) for each o€ 04(V) 

4) O(c) =O(f(o)) for each o€ O4(V). 
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Proof. We may write V == <4, B> L W where AB = 1, B? =0. If O€W 
we have for each o€ Oa(V), the unique decomposition 


o(C) = de(C)A + bo(C) B+ ow (C) 


where @o(C), bc(C) € K andow(C) € W. And 0 = A - O — A ; o(0) =— b,(0). 
A trivial computation shows that ac€ W’ and ow € Homg(W,W). Also 
C? =o (0)? = (ac(C)A+on(C))? =ow(C)*? hence ow€ O(W) since W is 
non-singular. It is also easy to verify that for any o,r € O4(V), (or) w = owrw. 
Hence the mapping f: O4(V) > O(W) given by f(c) =o is a morphism. 
If AC O(W), set c= lca, LA and we seo that f(o) =A whence f is an 
epimorphism. Now o€ Kerf if and only if cov —1y. Thus g€ Kerf if and 
only if o(C) =ac(C)A+C for all CE W. Define a map g: Kerf— W’ by 
setting g(o) do and one readily verifies that g is an isomorphism. To 
compute detow we write o(B) ==24-+ yB+D for some DEW and note 
that 1 = AB =A 'o(B) =y. Hence for a given choice of basis for W the 
matrix of o, denoted (o), has the shape 


HO 


1 0 
* j a 
* 0 


(ow) 
* 9 

hence deto == det f(e). Finally we look at the spinor norm. Let rg€ O4(P). 
Then FA =0 and H—2A-+D for some eK, DEW and 04H? =P, 
Thus if CE W, ra(C) =— 2a(CD/D?)A+7p(C) as a simple computation 
shows. Thus f(rz) = rn and 0(rg) = EK * =— PK = 0 (tp) —O(f(ra)). 
Now let ow € O(W) and write ow = rn,‘ ` ‘tp, with DE W for t—=1, - -,r. 
Set vera‘ rg, where E= gA +D, for some EKE (te1,---,1). 
Then f(c) =ow and 6(c) 6(f(c)). Since every element of O4(V) whose 
image under f is ow is of the form od for some A€ Kerf we will be through 
if we prove 6(Ker f) = K**. If Aà € Kerf we have seen that A(C) —ao(C)A +0 
for som ac€ W’. Set W==<Ci>1- + -L<Cm>, po, = t-40,(0,)4-0,70, for 
i=], m and p= po" ` ‘pe, Then p and po, (i==1,' -,m) are in 
O*(V) and we have po,(A) =A, po,(Cy) =aA(Cy) for il,‘ + -,m and if 
+544, po,(Cy) =C; for j—=1,---,m. Hence p(A) —=A—=A(A) and p(C) 
==A(C;) for t+—1,:--,m. Thus p and A agree on the singular hyperplane 
<A>* and hence agree on V (see [1], Theorem 3.17). Thus p—=A, 
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0) =Ñ 0 (po) = Ke" 


` and the theorem is proved. 


CoRoLLARY 1. 6(04*(V)) =0(0*(W)). 
Proof. Immediate by 3) and 4). 


CoRoLLARY 2. If dim V—3 then O4*(V) =K*, the additive group of 
scalars. 


Proof. dim W—1 hence O*(W) is trivial and W’=K*. (See [1], 
p. 183.) 


For future convenience we set 
(4) = {X € Y | Z? = Å, A € F}. 


Then O(V) operates transitively on 1(A). A subgroup H of O(V) is called 
length-transttive if H operates transitively on 1(A) for each A€ F. 


3. The basic result. 


Lemma 1. Let V be a non-singular quadratic space of dimension = 2 
"wer K. If AEF, then #(1(A) mod O*(V)) —=1 unless A ts a non-zero 
isotropic vector and V is a hyperbolic plane in which case #(l(A) mod O*(V)) 
— 2, 


Proof. Of course O(V) /0*(P) is a cyclic group of order 2. If A 
is anisotropic, then O4(V)Ot(V)/O*(V) = O4(V)/Os*(V). There is a 
canonical isomorphism of O4(V) onto O(<A>*) which maps O4*(V) onto 
O+(<AS*). Thus O4(V)O*(V)/O*(V) 2¢0(<d>*)/O*(<A*), a cyclic 
group of order 2. Now invoke Proposition 1. If dim V=3 and A is non- 
zero isotropic then 


O4(V)O*(V)/0*(V) =0(W)/O*(W) where <A>* = <A) LW, 


W non-singular as one easily sees by Theorem 1.. As before, invoke Proposi- ’ 
tion 1. Finally suppose V is a hyperbolic plane and A is non-zero isotropic. 
Then O4(V) is trivial. (See [1], Theorem 3.17.) By Proposition 1. 
#(1(A) mod O*(V)) = 2. g.ed. 

For future use we collect several well known facts and state them as 


1 


40 . BARTH POLLAK. 


Lemma 2. Let V be a non-singular quadratic space. If dim V 22 and 
Y is isotropic (i. e., contains a non-zero isotropic vector), then 6(0*(V)) = K*. 
If V is anisotropic, then 6(O+(V)) =K** tf dimV=1; Nuyx(#*) if 
dim V = 2 where E=K((—d(V))}). 


THrorem 2. Let V bea non-singular quadratic space of dimin >2. 
If A is any anisotropic vector, then 


#(1(A) mod 0’(V)) = (8(0*(V)) : 8(0*(<A>*)). 


If A is a non-zero isotropic vector, dim V = 3 and <Ay*—= <A> LW, W non- 
singular, then 


#(1(A) mod 07(V)) = (6(0*(V)): 6(O0*(W))). 
If A is a non-zero tsotropic ‘vector and dim V—2, then 
#(1(A) mod O’(V)) =2(K*: K**). 


If V is isotropic then (V) =O" (V) and hence we obtain #(1(A) mod Q(V)). 
If V is anisotropic and 0’(<A)*) = 0(<A>*) then 
#(1(A) mod Q(V)) = #(1(A) mod 0’(V)) (0 (V): A(7)). 


Proof. If A is anisotropic, O1t(V) = O+(<A>*) whence 6(O4*(V)) 
—6(0*(<A>*)). If A is non-zero isotropic and dim V = 3 then 6(O4*(V)) 
—=6(O0*(W)) by Corollary 1. Now O+(V)/O’(V) =6(0'(V)) and under 
this isomorphism O4*(V)O’(V)/O’(V) is mapped onto 6(O4*(V)). Now 
apply Proposition 2 to S=1(4), G=O(V), Hm O*+(V), N=0’(V) and 
-use Lemma 1. If A is non-zero isotropic and dim V == 2 then apply Proposi- 
tion 2 as before using the results of Lemma 1 and Lemma 2. That 0’(V) 
==0(V) when V is isotropic is well known. (See [1], Theorem 5.17.). 
To finish the proof, we apply Proposition 2 with S=1(A), G=O+(V), 
H=0O'(V) and N=—Q(V) and we see that all we need do is show that 
(O (VY) N Oa*(V))Q(V) =9(7). Now 

(O°(V) N Oat (V))Q(V) /Q(V) = O’(V) N Ont (V)/Q(V) NOT). 
There is a canonical isomorphism f mapping Oa*(V) onto O+(<A>*). f sends 
O/(V) N Oat(V) onto O’(<A>*) and A(V) N O4*(V) onto a aubgroup- H 
of O*(<A>*) containing Q(<A>*). Hence 


, oO (VW) N Oat (V)/Q(V) N Oat (V) = 0’(<A>*)/H. 
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But 0’(<A>*) =N(<A>*) by hypothesis. Thus 0’(<A>*)/H is trivial and 
the proof is complete. 


CoroLzary 8. Let V be a non-singular 2-dimensional quadratic space. 
Then O'(V)=Q(V). If A is anisotropic, then 


#(1(A) mod Q(V)) = (K*: K*?) 


tf V ts isotropic; (Nux(#*): K**) tf V is anisotropic where E 
== K((—d(V))*). If A is non-zero isotropic, then #(1(A) mod Q(V)) 
== 2(K*: K+). 


Proof. That o(V)=0'(V) for 2-dimensional non-singular quadratic 
spaces is well known. (See [1], Theorem 5.14.) The result follows imme- 
diately from Theorem 2 and Lemma 2. 


4. K isa finite field. 


Lemma 3. Let V be a non-singular quadratic space over a fintte field 
K. Then O'(V) =Q(V) and 6(0*(V)) =K* if dim V =—=1; K* if dim 
Vee. 


Proof. If dim V= 3, then it is well known that V possesses non-zero 
isotropic vectors. Since 0’7(V)=OQ(V) for any K if dim V <3, we have 
O’(V) =Q(V) always. The assertions concerning #(O0*(V)) are also im- 
mediate with the exception of an anisotropic 2-dimensional space. But 
. K* = Npr; (E*) is well known (see [2], Lemma on p. 131) and we are 
through. 


THEOREM 3. Let V be a non-singular quadratic space of dimension 
= 2 over a finite field. Then Q(V) =0'(V) and #(1(A) mod Q(V)) =1 
if dimV=4 or dim V —3 and A is anisotropic; 2 tf dim V =3 and A is 
non-zero isotropic or dim V =? and A ts anisotropic; 4 if dim V ==? and A 
is non-zero isotropic. 


Proof. Immediate by Theorem 2, Corollary 3, Lemma 3 and the well 
known index relation (K*: K*?) 2 for K a finite field of odd characteristic. 

CoroLLarY 4. O/(V)=O(V) is length-transitive if and only if 
dim V = 4. 
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5. K is the field of real numbers. 


Lemma 4. Let V be a non-singular quadratic space over the field of 
real numbers. Then Q(V) —=O'(V) and 6(0*(V)) =K*™ if V is amiso- 
tropic; K* tf V is tsotropic. 


Proof. It is well known that Q(V)—=O’(V). (For a proof, use 
Theorem 5.14 and Theorem 6.16 of [1].) The assertion concerning 
6(0*(V)) is obvious. 


THEOREM 4, Let V be a non-singular quadratic space of dimension 
== 2 over the real numbers. Then QO(V)=O'(V). If V ts anisotropic, 
#(1(A) mod Q(V)) ==1. If V is isotropic, then #(1(A) modQ(V)) —1 if 
either A is anisotropic and <A>* is isotropic or A is non-zero tsolropic, 
dim V = 3 and the Witt index of V>1; 2 if either <A>* ts anisotropic or 
A is non-zero isotropic, dim V = 3 and the Witt index of V1; 4 if A is 
non-zero isotropic and dim V =2. 


Proof. Immediate by Theorem 2, Lemma 4 and the index relation 
(K*:K**) —2 for K the field of real numbers. 


COROLLARY 5. Q(V) =O (V) ts length transitwe tf and only if the 
Witt index of V 41. 


6. K is a local field. By a local field we mean a field K complete with 
respect to a discrete valuation having finite residue class field K’. Following 
O’Meara (see [6], $63) we call X ‘dyadic (non-dyadic) if the characteristic 
of K’ is 2 (not 2). The values of two group indices germane to the issue 
are given in 


Lemma 5. Let K be a local field (of characteristic 542) and E/K a 
quadratic extension. Then (K*: Nay (H*))=2 and (Na,x(E*): K**) 
== 2012 where q is the number of elements in K’. 


Proof. These are well known results of local class field theory. (See 
[2], Chapters 8 and 10 or [6], 863.) 


Lemma 6. Let V be a non-singular quadratic space over a local field K. 
If dim V = 3 then 0(O*(V)) =K*. If K is dyadic, then A(V) =O0'(7). 
If K is non-dyadic, then O(V) =O'(V) unless dimV—=4 and V is aniso- 
tropic in which case (0’(V): (V)) =2. 
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Proof. If dim V = 4 then it is wai known that’ V assumes every possible 
length (see [8], Satz 15 and Satz 16) and the result follows. It is also 
obvious if V is 3-dimensional isotropic. ‘If V is 3-dimensional anisotropic 
then there is exactly one class « of K* mod K*? which is not achieved as a 
length. (See [8], Satz 14 and Satz 15.) If £ is a class distinct from a 
and 1 ( exists since (K*: K**) = 4) then gga and a= f- aß. Since 
B and af are classes assumed by V as lengths, a€6(O*(V)) also. The 
remaining assertions constitute Theorem C of.[7]. 


Tusorem 5. Let V be a non-singular quadratic space of dimension = 2 
over a local field. Then #(1(A) modO’(V)) =1 if either dim VÈB or 
dim F 4 and A is anisotropic or dim V — 4, A is non-zero isotropic and Witt 
index of V ==2; 2 tf either dim V = 4, A non-zero isotropic and Witt index 
of V =1 or dim V —=3 and A is anisotropic; 2g? if dim VF =È? and V is 
anisotropic; 4g%4* tf either dimV—3 and A is non-zero isotropic or 
dim V == 2, V isotropic and A is en: a if dim V =—2 and A is 
non-zero isotropic. 


Proof. Immediate by Thsorarns 2, rer 3, Lemma 5 and Lemma 6. | 


CoROLLARY 6. O’(V) is length- anti if and only if dim v2 5 or 
dim V == 4 and the Witt index of VAL 


Remark 2. For local fields the condition Witt index 1 for 4-dimen- 
sional non-singular quadratic spaces is equivalent to the condition d(V) € K*. 


THEOREM 6. Let V be a non-singular quadratic space of dimension 
= 2 over a local field K. Then #(1(A) modQ(V)) —#(1(A) mod 0’(V)) 
unless K is non-dyadic, dim V.—= 4 and V anisotropic in which case 


#(1(A) mod Q(V)) = 2[#(1(A) mod 0’(V))). 
Proof.. Immediate from Theorem 2, Theorem 5 and Lemma 6. 
COROLLARY 7. 0(V) is length-transitive if and only if dim V 25 or 


dim V—=4 and the Witt index of V1 ga K ts ee the Witt index of 
V =2 if K i pan diate. 


7. K isa global field. By a global field we mean either an algebraic 
number field or an algebraic function field in one variable with finite constant 
field. If p is a prime of K we will denote the completion of K at p by Ky 
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and if U is any subspace of V we will denote by U, the scalar extension of 
U by Ky. Of course U, becomes a quadratic space over Ky in a natural 
manner. If R denotes any (possibly empty) set of real infinite primes of K 
then by K*(R) we denote the set of all elements of K* which are positive 
at each p of `R. 


Lemma 7. Let K be a global field (of characteristic 42). Let 8, T 
be. sets of real infinite primes of K satisfying SET. Let ag K* and 
suppose —a€ K*(8) so that N5,x(E*) CK*(8) where E —K (at). Then 
(K*(8): K*(T)) =2*T-9 and both (K*(8): Nayx(E*)) and (Nx x(£*): K*) 
are infinite. 


Proof. If T is empty the first assertion is trivial. So suppose T is 
non-empty and let 7—S—{p,,:--,p,}. For i=l, ' -r let fi be the 
injection map of K into its completion Ky, at p. Define a map 


f: E*(S) > (Ky*/Ky.*) X` X (Kp.*/Ky,**) 


by f(x) = (f:(2)Ky,*?,- + +, fr(v)Kp,**). f is obviously.a morphism. By 
the weak approximation theorem (see [2], Theorem 8 of Chapter 1) it easily 
follows that f is surjective. Clearly Kerf=K*(T) and the first assertion 
is proved. Suppose (K*(8): Ns,x(E*)) was finite. Let b,,---+,d, be a 
complete set of representatives for K*(S)/Na/x(#*) in K*($) and suppose 
b, represents Ny/x(H*). For each i>1 there exists a prime p; such that 
bi ¢ NEp,/Kp, (Ey,*) where Ep, =K, (a). Note that p S. Let q be a 
prime such that qé {pa ',pn} US and also ag Ky*. Let cq€ Kq* but 
ca ¢ Naqkq (Ea*). By the weak approximation theorem there exists be K* 
such that b= cqmod Kq** and b= 1modK,*? for pE {py + +, Pa} U S. 
Thus be K*(8), bé Nxx(H*) and 6b;=b,mod Nap Ky, (Ey,*) for t—2, 
>on. Thus bbi Nux(E*) for i= 1,: - +, which contradicts the choice 
of 6,,- - -,0, as a complete set of representatives. 

Finally suppose (WV5/x(H*) : K*?) is finite. Let ct > +, Cn be a com- 
plete system of representatives for Np,z(E*)/K*? in Nxyx(B*) and suppose 
¢, represents K**. For each t>1 there exists a finite prime p; such that 
ag Ky,**. Let q be a finite prime such that qp; for i=2, -,n. 
Select bg € Naq/kq (Hq*) but bag Kq**. There exist zu,ya€ Ka such that 
Tq? —aYya’— be. By the weak approximation theorem we can find z,y¢K 
such that z is very close to % in Ka and very close to 1 in Ky, for 
t==2,---+,n and y is very close to Ya in Ka and very close to 0 in Ky, for 
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t—=2,---,n. Set comc*—ay’, Then cE Nayx (B®). By the continuity 
of addition and multiplication in Ka, c=b mod Ką”? if our een 
are good enough. Hence cg K*. And ce Ky,*? for i—2,: >n if our 
approximations are sufficiently good. But then c= c mod Ky,” whence 
cag K*? for t—1,---,n. This contradicts the fact that c,---,¢, con- 
stitute a complete set of representatives and the Lemma is proved. 


Lemma 8. Let V be a non-singular quadratic space over a global field. 
If dim V È 8, then 0(O*(V)) == K*(8) where 8 consists of those real infinite 
primes p for which Vy is anisotropic. If dim V 4, then Q(V) —=O'(V). 
If dim V==4 then O’(V)/o(V) = TL 0 (7})/8 (7) where R is the set 


of finite non-dyadic p for which Vy is anisotropic. 


Proof. These assertions are due to Kneser. (See [5] Satz A and Satz 
B for proofs of the first two assertions and [7] Theorem B for a proof of the 
last assertion.) Although they are stated only for algebraic number fields, 
the argument also works in the (easier) function field case. 


THEOREM 7. Let V be a non-singular quadratic space of dimension = 2 
over a global field. Let 8 denote the set of all real infinite primes p for 
which Vy is anisotropic. If A is an anisotropic vector, let T(A) denote the 
set of all real infinite primes p for which <AY*p is anisotropic. Then 
#(1(A) mod O'(V)) = 2474-9 if either dim V = 4 or dim V =3 and (Ay? 
is isotropic; œ otherwise. If A is a non-zero isotropic vector and dim V = 3, 
let T(A) denote the set of all real infinite primes p for which Wy is aniso- 
tropic where <A>* == <A) LW, W non-singular. Then #(1(A) mod0’(V)) 
AHA if either dim V = 5 or dim V = 4 and the Witt index of V—2; 
oo otherwise. 


Proof. A straightforward application of Theorem 2, re 3, Lemma 
7 and Lemma 8. 


COROLLARY 8. O’(V) is length-transttive if and only if the Witt index 
of Vy1 for all real infinite p and either dim V>5 or dim V = 4 and the 
Witt index of V 1. 


THRORRM 8. Let V be a non-singular quadratic space of dimension = 2 
over a global field. Then #(1(A) modQ(V)) —#(1(A) mod O'(V)) if 
dimV 44. If dim V =4, then #(l(A) mod Q(V)) —2*[#(U(A) mod 0’(V))] 
where r is the number of finite non-dyadic p for which Vy is anisotropic. 
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Proof. Immediate from Theorem 2, Theorem 7 and Lemma 8. 


COROLLARY 9. O(V) is length-transitive if and only if the Witt index 
of Vy=41 for all real infinite p and either dim V = 5 or dim V —4, the Witi 
index of V1 and V, is isotropic at all finite non-dyadic p. 
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CONTRACTIBLE SEMIGROUPS HAVE NO SELF-LINKED 
COMPACT SUBGROUPS.* 


By Pav S. Mosterr.! 


Wallace has asked the following question [2, p. 324]: If Euclidean n- 
space R” is supplied with a continuous associative multiplication with identity, 
and @ is a compact connected subgroup of R” under the given multiplication, 
and contains the identity, can @ be self-linked?* M. L. Curtis [1] has 
solved the question in the case where n == 3, the assumption that AH contains 
the identity being dropped. Actually, the dimension and properties of 
Euclidean space (except the contractibility) have nothing to do with the 
question, nor does the existence of an identity as we see from the following 
proof of the title. 


Proof. Let T be a contractible semigroup? and G a compact subgroup 
thereof. We denote the identity of G by e. Then S=eTe ig again a 
contractible semigroup and has e as its identity. Let r: SxXI—-8 be a 
homotopy, where J denotes the unit interval [0,1], and x satisfies r(a,0) = gz, 
(2,1) = for every zE 8, x being some fixed element of S. We have the 
following cases: 


(a) Suppose S is compact. If 9 is a group, since it is contractible, 
it is a point. Otherwise, it contains a proper minimal ideal K [3]. Choose 
an element kE K. Then k NAGCKN G=. 

If $ is not compact, since Gr(G X JI)G is compact, there is an element 
y Gr(@XI)G. Then we have either 


O) yEr(EXDENG-—B 
or 

(c) yGr(GXI)GN GØ in which case there is an element z€ 8 
such that yz =e. Then if z@r(G X I) N GØ, by multiplying on the left by 


* Received February 12, 1962. 

1 This work was supported by the National Science Foundation. The author wishes 
to thank A. M. Gleason for a pair of valuable comments concerning the proof. 

2 A set F is self-linked in X if there is no homotopy 3, of F to a point such that 
8,(F) N F Ø if and only if t = 0, where X is a contractible space. 

> A semigroup is a Hausdorff space with a continuous, associative multiplication. 
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. Y, we have that Gr (G X I)G contains yG contradicting the choice of y. Hence 
26H (EXTNEaNG=B. 


Now let p denote the point k, y, or z according as we have case (a), e) 
or (c). Then we have 


(*) pGr(G4XTGnG—G. 

There is an arc a:[0,1] 8S with a(0) =p and a(1) —e, since S is 
arcwise connected. Let 2, be the smallest number such that a(t) € Œ. Then 
ta is greater than zero. Say a(t.) go. Define now ¢: G X I—8S by 

a(t)—2tot) goth, OStS} 
en), Jeizı. 
Clearly ¢ is continuous. Moreover #(h,0) =h, $(h,1) = pgo™to. 

Now suppose ¢ (h, t) € @forsomet,h. Ift<4, we have a(t,—2tot) E€ G 
so that t=0. If t>4, we have pgo'n(h,2?—1)E€ G contradicting (*). 
Hence ¢ is a homotopy contracting G to a point in S, and hence in T, such 
that (h, t) € G if and only if t—0. 


TULANE UNIVERSITY. 


REFERENCES. 





[1] M. L. Curtis, “Self-linked subgroups of semigroups,” American Journal of Mathe- 
matics, vol. 81 (1959), pp. 889-882. , 
[2] A. D. Wallace, “ Problems on semigroups,” Colleotanea Mathematica (Barcelona), 
vol. 8 (1961), pp. 223-224. : 
» “The structure of topological semigroups,” Bulletin of the American 
Mathematical Society, vol. 61 (1955), pp. 95-112. ` 





[3] 


ON A CUBIC EXPONENTIAL SUM IN THREE VARIABLES.* 


By L. J. Mornzny.? 


Let p be a prime and let f(#,y,z) be a cubic polynomial with integer 
coefficients, which is not a function of less than three independent variables. 
Write e(t) == e(2rit/p) and 


pl 
(1) S= 23 e(f(z,9,2))- 
zıY.2=0 
Very little is known about the exact order of magnitude of such sums 
for large p. An obvious conjecture for general f(x,y,z) is 
(2) S==O(pi), 


where the constant implied in O is independent of the coefficients of f(s, y, z). 
The result (2) is now proved for the special case when 


(3) f(x, y, 2) = ar? + by? + cz? + deyz, abed £0, 
except when d=—-2Yabc when we have an estimate O (p°). 
The method of proof is similar [1] to that used in proving that 
i u 
S e(ac? + by? + cay) = 0 (p). 
ayy=0 


On multiplying (1) by e(—aw?) and summing for w, we have 


de 5 e(— aw? + at? + by? -+ 02° + deyz), 


(4) 10=0 , DYE w= 
—a\, ss p1 
(S*)ievervis— S neun +) 8 
P N,=0 
say, where f(n) is the number of solutions in 2, y, w of 
(5) aan: + by? + an + dayz, 
where all congruences are taken (modp). It suffices now to prove that 


0). 
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In a recent paper, [2] I have found by elementary means simple closed 
expressions for the number of solutions of 


(6) w=2?+ By? + CB? + DBay, B3£0. 
Now 


B=b/a, OB=n, DB=dz/a, 
and so D= dz/b, C ==na?/b? with the usual meaning of 1/a mod p etc. 


When C=0, ie. n=0, f(0)—p?+O0(p). Consider first the cases 
when p=—1mod3), and p=1(mod3) with B a cubic residue of p. 
From equation (16) of [2] we have when n>£0, 


+2 =. 7 
D irte (G) (FL +2 DERC) 4 py (Por + De + Comme 
where the brackets denote Jacobi-Legendre symbols. Hence 


8 3 (P+ 0(p) el”) +T, 


S, Z [e+e (5 ) (Fern) i > a) es 


where 2r? + der/b + na*/b? =0. 
ur 1 
The p? terms contribute 0 to S’. The term O(p) X e(cz?) gives O (pł). 
: . s=0 
For the second term in T, put m == d*z*/b® + 2%na?/b*. It becomes 
3 z m — bm (= ) 3 i 
» (2) 2 (2): ava a T° a]. 
In the summation, since. ns<0, we must exclude m= z/b. 
The sum in m is a Gaussian sum and gives O(Vp). The sum in z 
gives O(Vp) unless d*+ 2%abc=0 when it gives O(p). The third sum 


in T is also O (p) as we prove now. With a slight change in the variables, it 
suffices to show that 


© [U 8 2 2 u 
(8) = (7) e(PU° + QU'Y + RUY* + 87°) —0 (p). 
Put V=UW, then (8) becomes 


S U 8 2 8 
BA e(U®(P + QW + RW? + 8W°)). 


OUBIC EXPONENTIAL SUM. öl 


On replacing U by AU?, it suffices to show that 


(9) = SUP +0W+RWHEM)) = 0 (p). 
Let l 


pt Za pi — 
ZelnV°)—= V p, + +, B elr U’) = deV p, 
U=0 U=0 


where 3,-=O(1),:- +, dg—O(1), and rı * -,1re are representatives of the ` 
sixth power residue classes of p. Let M, etc. denote the number of solutions 
of n2=P+QW-+RW®LSW®. ‘Then Mi—p+O(Vp) by Weil’s 
theorem since from (2) the cubic in (9) cannot be a multiple of a cube of 
a linear form. Hence , 


68” — Vpdi(p+O(Vp) +: -+ Vpde(p-+0(Vp)) =O(p). 
since ds +---+d,—0. 


Suppose next that p==1 (mod 3) and that B is a non-cubic residue of p. 
Now from equation (18) of [2] when n540, 


tree) 


6r—D 
-#3 ( p ) 
taken over 27° + Dr? -+ Os=0 with N, solutions. 


The first and the last two terms in (8) have already been dealt with 
giving a contribution O(p*) unless d? -+ 2Yabc==0 when they give O (pt). 
The second term contributes 


m = 
3 (Z) eant ce) 0m), 
n=1e-0 \ P 

The third term gives 

p-1 n 

3p > (5) Ne(—an + cz?) 

meo \ P 

where 
dz 2 
art rt FE 0 

This is O(p?), for an n substituting for n, we are led to a series such as (8). 


This finishes the proof. 
The same method shows that if 


(11) Six $ x(z)e(az" + by? + ca’ + deyz), 
As f . 
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where X(z) is a multiplicative non principal character mod p, then also 
8, == O (pì). Now the z sum arising from (7) is 


UX(z)¢ ( (e+ ap”) . 


The sum in z is zero if d? = — 2Yabc, and also when d’ ze — 2%abe when 
p==—1(mod3). If p=1 (mod3), the sum is O(Yp). 
: On noting how (11) arises, the linear term there is not a factor of the 


cubic term. Now (8) becomes 


5 (2) x(P)e(PU° + QU2V + RUV? + SV), 


U,V=0 
and with V == UW, this is 


5 (5) x(U)x(W)e(U*(P + QW 4+ RW? + SW*)) 
U,W=0 


It is easily seen that this sum is also O(p) since the sum in U is 
xX (P+ QW + RW?+SW°) where x’ is a multiplicative character. 
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NOTE ON THE REDUCTION OF INDUCED REPRESENTATIONS.* 


By Pararora A. TUCKER. 


1. Introduction. Let @ be a finite group with a normal subgroup H. 
If L is an irreducible left K(H)-module, then one is interested in deter- 
mining the components of the induced module LO =K(G)®xımZ. In this 
paper the indecomposable components of L@ are determined when K is an 
algebraically closed field of characteristic p = 0. This is an extension of the 
author’s earlier results [1] in which G was assumed to be a split extension 
of H by G/H. The development presented here will depend heavily upon 
the results in [1]. 


2. Construction of the indecomposable components. Let G be a finite 
group with normal subgroup H. Let @ be an extension of H by B where the 
elements of B are bı == 1, ba,- >+, bn. To each element of B, there corres- 
ponds a coset of H in G. Let the left coset representatives of H in G be 
bi = 1, ba ` + +, bn. If G is actually a split extension of H by G/H, consider 
B as a subgroup of G and take b; = b, t= 1,- +- n., Thus, 


Gua H+ 56,H +: e -16,H. 
Each bE B defines an automorphism of H by h> (5) "hb—=hb, for every 


hed. ; 
Multiplication of elements of G is given by 


(1) Eh- D'R == bb’ (b, b’) h®h’, where b,b’€ B and h, h€ H. 


{ (bs, b) | 1S ij &n} is the factor set of the extension. Since b, ==1, 
(1, ;) = 1 == (b,1), for every j. From the associative law for multiplication 
of elements of G, it follows that for every 1, j, and k 


(2) (bby, bx) (Bs, by) * == (bi, bibr) (bs, bx). 

Let T be an irreducible representation of H over an algebraically closed 
field K of characteristic p20. Let L be a left K(H)-module which is a 
representation module for T. 


The conjugate representation of T under ze G is denoted by T® and 
is such that T® (h) = T (aths), for all he H. 


” Received September 15, 1962. 
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Lemma 1. Let S={bEB|T® is equivalent to T}. Then, S is a 
subgroup of B. 

If G is a split extension of H by OH, then bb and § as defined here 
is the same 8 as in [1]. 

_ Proof. If be 8, then there exists a non-singular linear transformation 
Dy of L such that D,T@(h) Dyt == T(h), for every h € H, i.e., DypTODy = T. 
The proof of the lemma follows immediately from the. following: 

(8) (T((b,0=)) =D) T®®)T((b,0+)) D =T 
(4) TO) = T ( (b,b) ) Dyr Dr TD DyT( (b, b’) 7. 

For every bE 8, select a linear transformation D, of L such that 
D,T®D,!=T and D,—1r. Then, for every 1€ L, he H, Dhè Dyl = hl. 
Let b and b’€ 8. From (4) it follows that 

T = (DyDyT ((b,8/))*) TE (DyDyT ((b, 81) =) 
By definition of Dav, T me Day TOD yy? Thus, by Schur’s Lemma 
(5) DyDyT ((b,8/))* =£ (b, 0!) Dw, 
where 6(b,b’) € K* = {ke K | k0}. 

Lamma 2. Bisa factor set of 8. 

Proof. One only needs to prove that for every a,b,c €S, Ba be) B (b, c) 
—B(a,b)B(ab,c). Now, 

B (a, b) B (ab, c) = DeDoI'( (a, b) ) > Dav DavDoT ( (ab, c) ) = Dave 
= DaDoT ( (a, b) ) D.T ( (a, be) (b, c) ( (a, b)°) >) Dan 
== DaDiT ( (a,b) )*DoP ((a, b)°)T((b,c)) >T ( (a, be) )*Davo™ 
=D DoT ( (a, b) ) T ( (a, b) ) DoT ( (b, c) ) Dro *Da*8 (a, be) 
== Daf (b, ¢) DooDoo Dap (a, bc) = B (a, bc) 8 (b, c). l 

It can be proved that if any other selection is made for the Dys, then 
the resulting factor set is equivalent to 8. Conversely, let 8’ be a factor set 
of S which is equivalent to 8. Then, there exists a function p: S— K* such 
that 6’ (b,a) = 8 (a, b)p(ab)p(a)*p(b)~, for every a,b € 8. Let Or = p(b) Dr. 
Then, CyT©®Oyt == T and COT ( (b, 0’) ) = p (b, b)Cow. Thus, T uniquely 
determines up to equivalence a factor set of J. 

Let (KS) ga denote the 8-twisted group algebra of 9, i.e., the crossed 
product of K and 8 with factor set 8+ (See [1].) Since 8 is equivalent to £’ 
if and only if £~ is equivalent to (’)~*, it follows that T determines up to 
equivalence (KS)g-. The elements of (KS)g+1 will be denoted by s, where 


s= X &(b)b. 
des 


INDUCED REPRESENTATIONS. 55 


Let ay y=1, : -,r—=[B: 8] and a= 1, be a complete set of left 
coset representatives of S in B. Then, B—S-+a4,8-++---+a,8. It can 
be proved that 7°) is inequivalent to TN, for y 74A. 

The left K(G)-module LO for TC has dimension [B: 1] (L: K) and is 
generated as a vector space over K by the elements 


{ab @1|1SySr, bES, le L}. 


For every y—=1,° - -,17, 8€(KS8)g+, and Le L, define an element c(ay, s, t) € LO 
by 
c (Gy, 8, }) —= IE) BOT b)) Dyl. 
€ 


If G is a split extension of H by G/H, then (a,b) 1 and c(a,,8,1) is the 
same as C(@y,8,1) in [1]. The c(a,,8,1)’s satisfy the following properties: 


Property 1. c(ay,8 +S, l) = c (dy, 8,}) + ¢(ay, 8’, 1). 
Property 2. € (ay, 8, l + r) >= 0 (dy, 8, 1) oe c (ay, 8, v) ’ 
Property 3. If kE K, then f 


k(¢(ay, 8, 1)) = c(a, ks, l) —C(ay, 8, kl). 
Property 4. IE he H, then h(c(ay,s,1)) = c(a,, 8, hel). 
Property 5. If be S, then 
b (c (ay, 8, t)) == c (ay b’ `s, DyT ((a; v))“T( (b, ay) )t), 


where bay = ab’ and b -s= 2 é (b)8(', b) 70b, i.e, the product of b 
be 
and sin (K8) p+. 


Property 6. If ag is a coset representative of S in B, then 
Hp (Cay, 8,1)) = e(a 8-8, Dr ( (ay, 8"))*Z ( (big) 2), 
where agay = ab’. 
Proof of Property 4. 
h(¢ (ay, 8, 1) ) hl E é (b)ab @ T( (a,b) ) Dol) 

= 2 é (b)hayb OT (ay, b))D™ . 
=Z Ea, ayb) h Q T ( (dy, b)) Dy 
= E ijab @ howl ( (a, b)) Dy! 
= IOTI T ( (ay, b) ) Dohir — c (ay, S, hl). 
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Proof of Property 5. For convenience, replace b by b.. 
bi (c(ay8,1)) =b E £4()ayb 8 T ( (ay, b)) Dy?) 
= Lé b)bab DT (ay, b)) Dal 
= E £ (b) baad (bs, ayb) @ T ( (ay, b)) Doh 
=Z ilad @ 7 ( (0s; ayb) )T ( (ay, b)) Dy. 
Now, 
T ( (ba, ayb) ) T ( (ay, b)) Dot —= T ( (br, ayb) (ay, b) ) Dy 
—= T ( (bray, b) (ba, ay)?) Dot =— T( (dnb, b) (ba, dy)®) Dy 
=T ( (a, bb) (b,b) (ar, b')?)= (ba, ay) ?) Dy 
= T ( (an, bb) )T( (8, b) ) TO ( (ay, b’) (ba, dy) ) Dy 
— T ( (ay, 0b) )T( (0, b) ) DT ( (aa, 0’) + (ba, ay) ) 
=T ( (a, bb) ) B (0, 6) Dor DyT ( (a, b) (ba, ay) ). 
Thus, 
ba (elam s,1)) = E é (b) 6 (0, b) abd 
B (T( (an, bb) ) Dow DT (a, b) ) 7 ( (bs, ay) )1). 
The proof of Property 6 is similar. ' 
Let I be a left ideal of (KS)g+. Define C(I) to be the K-subspace of LO 
generated by the elements 
{6(dy, 8,1) | 1SySr,s€ (KS), 1€ L). 
From Properties 4, 5, and 6, C(I) is a left K(@)-module. It can be 
shown (as in [1]) that (C(I): K)—[B: 8](I: K)(L: K) and that if 


{»|1SkS(I: K)} forms a basis for I and if {1, Jis goa K)} forms 
a basis for L, then a 
(clasa) |1SySrisk<(l: K),1SpS(L: K)} 

‚forms a basis for O(I). b 

THEOREM 1. Let I,,- > -,I; be left ideals of (KS)g-ı such that (K8) pa 
=: OLI. Then, LO=0(1L) @---OC(h). 

The ot of this theorem is esecntially identical to the proof of Theorem 
4 in [1]. 


THEOREM 2. Let I, and I, be left ideals of (K8) ps. Then, there exists 
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a K-isomorphism 6 of Homcrsy,1(11,12) onto Homa ia) (O(I), C(I) ) such 
that if Pe Homcrsy2(Ii,[2), then P(c(ay,8,)) = ¢(ay,Ps,l), for every 
c{ay,8,1)€C(I,). If II, then 6 is an algebra isomorphism. 

‘The proof of this theorem follows the same pattern as the proof of 
Theorem 5 in [1]. Only a few minor as are necessary to extend that 
proof to this case. 


The following corollaries may be proved as in [1]. 
CoRoLLARY 1. I ts indecomposable if and only if C(I) is indecomposable. 


COROLLARY 2. LO is indecomposable if and only if (KS)g- is indecom- 
posable. 


COROLLARY 8. If the characteristic p of K does not divide [G: 1], 
then I is irreducible if and only tf C(I) ts irreducible. 


COROLLARY 4. Suppose p does not divide [G:1]. Let I, and I, be 
irreducible. Then, I, and I, are (K8)gs-tsomorphic if and only tf C(I) 
und C(I,) are K(@)-isomorphic. 


3. Further results. If 8B, then C(I) is X (@)-isomorphic to a left 
K(G)-module which is induced from a left K(SH)-module, where SH is a 
proper subgroup of @. 

Let 8={b|be 8}. Then, SH = {bh |be8,he H} is a subgroup of G. 
{ay | 1S yr} forms a complete set of left coset representatives of SH in G. 
Thus, G=-45H +:--+48H. 

Let I’ be the K-subspace of LO generated by {c(1,s,1)| s€, tE L}. 
Then, 

bh(c(1,8,4)) =6(c(1,s, Al)) = c(1,6-8, Diehl). 


Thus, J’ is a left K(SH)-module. It is easily checked that the linear trans- 
formation & of (I’) into C(I) such that $: a,@c(1,3,1) —> c(ay,s,1) is a 
K (G)-isomorphism of (J’)? onto C(I). nn (P)@ and O(I) are isomorphic 
as left K (G)-modules. 

As in the case of a split extension (see is $4]), it can be proved that I’ 
is K(SH)-isomorphic to the (inner) tensor product of two modules which 
afford projective representations of SH. Theorem 7 in [1] then holds with 
the condition that G is the split extension of H by G/H removed and a 
replaced by £. 
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4. Summary. 


THEOREM 3. Let G be a fintle group with normal subgroup H, G/H 
isomorphic to B. Let T be an irreducible representation of H over an 
algebraically closed field K of characteristic p. Let L be a representation 
module for T. Let S={b€B|T® is equivalent to T}. For each bE B, 
define a non-singular linear transformation D, of L such that D,T®D;* —T 
and D,=1r. Define B(b,W’)EeK* by D,DyT( (6, 0’) )+* = B(b, b’) Dey. 
B is a factor set of 8. Let (K8)g+ denote the B-twisted group algebra of 8. 

Each left ideal I of (K8)g+ determines a left K(G)-module C(I) of LO 
such that 


1) (O(I): K) = (I: K)[B: 8] (L: K). 

2) There exists a left X(SH)-module /’ such that I’ is K(SH)-iso- 
morphic to the tensor product of two modules which afford projective 
representations of SH and (I’)@ is K(@)-isomorphic to O(I). 

3) If I: ‚I; are left ideals of (K8)p- such that 

, (K8)s =I 8+: - Ol, 
then L°=C(1,)@---@C(L). 


4) If I, and I, are left ideals of (K9)g+, then Homiagy,+(11,12) is 
K-isomorphie to Homx,a) (C(11),C (I2)). (I£ I, = ],, then have an 
algebra isomorphism. ) 


Let J; denote the representation of G afforded by C(I). . Then, if S54 B, 
J, is an induced representation. If (KS8)gi=I,@---@I;, where the L 
are indecomposable left ideals, then TO == J7,@- - :® Jz, is a decomposition 
of TS into indecomposable representations. If p does not divide [@: 1], then 
the Jr, are irreducible and Jz, and Jr, are equivalent if and only if I; and 
I, are (KS) g--isomorphic. 
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"ON UNBOUNDED TOEPLITZ MATRICES.*! 


By PHILIP HARTMAN. 


1. Introduction. The function spaces LP below refer to functions of a 
real variable $ on the interval O<S$#=%r. (Null ¢-sets will be ignored 
without comment.) Let f(¢) € L? and 


(1-1) fo) ~ E faert 
and 
(1.2) -H= CE Ifo. 


Correspondingly, let 7? be the space of sequences f= (-- -,fa,fofu° °°) 
with a (finite) norm (1.2). Let f— (f,f*), where f* are the respective 


sequences "= (fo fo’), F= C ++, fafa) and let the corresponding 
functions f*(¢) be 


(1.3) P~ rem, Foren. 


The subspace of functions f*(#) of L? will be denoted by Z** and the corres- 
ponding space of sequences ft by 1+. When convenient, /?* will be considered 
a subspace of 7? by associating each element f*e /* with the doubly infinite 
sequence (0, ft) €P. Similarly, Z? and I or L* and [?* will be identified. _ 

Let L= L(f) and T=T(f) denote the Laurent and Toeplitz matrices 
belonging to f, i.e., L= (fam), Where n, m = 0, + 1,: - +, and T = (fam), 
where n, m= 0,1,:::. The symbols L(f), T(f) will also represent the 
corresponding operators of the spaces }, I+ or L*, £*+ into themselves with 
the largest domain that one can associate with the respective matrices. 

If f(¢) is real-valued, i.e., fa—f, then L and T are formally Her- 
mitian matrices. L, in fact, is a self-adjoint operator. It was pointed out 
in [4], p. 879, however, that 7’ need not be self-adjoint. A sufficient condition 
for T to be self-adjoint is that the real function f(¢) be bounded or half- 
bounded; [4]. 

The motivation for this paper was an investigation of conditions, necessary 
and/or sufficient, on a real-valued f(¢)¢€ L* for T(f) to be self-adjoint. 


* Received October 29, 1962. 
1 This research was supported by the Air Force Office of Scientific Research. 
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Actually, only the last section deals directly with this problem and depends 
on applications of the earlier sections which involve 7’(f) without the restric- 
tion that f(¢) is real-valued. 

The paper depends, in part, on the answer to the following question: 
Let ft(¢) in (1.8) be in L** and M (ft) —c.1.m.(f*, ftet#,- - -), the subspace 
(= closed, linear manifold) spanned by ftet"# for n=0,1,---. When is 
M(ft) =L*? This question was raised and investigated in Hartman [8]. 
Its complete answer was subsequently given in a well-known paper by Beurling 
[1]. He showed, among other things, that ft has an essentially unique 
factorization f+(¢) = fot(¢)fit(¢) into an “inner” and “outer” function, 
that | fo ($) | = 1, that M (f+) = M (fot) = fo* ($) -L*, and that M(f*) = L* 
if and only if for==const. The function f,* was given analytically and also 
geometrically in terms of projections in L**. Halmos paper [2] contains an 
elegant geometrical derivation of this result (but does not supply fot ana- 
lytically). The arguments below depend both on Beurling’s results and on 
Halmos’s results on a more general problem. 

By the use of these arguments, questions concerning the spectrum of T (f) 
are reduced in part to an investigation of T'(f,) for a suitable fo() with 
| fo(@)|==1. When f(¢), 1/f(¢) are both bounded, such a reduction was 
made by Widom [11] with f.—f/|f|. 


2. The subspaces M(f). Let U denote the unitary operator of L? onto 
itself defined by Uf(¢) —f($)e#; so that U*f(¢) =U ($) =f (p) e*t. 
A subspace M of L° is an invariant subspace of U if U(M)C M and reduces 
U if U(M)C M, U*(M)C M. An invariant subspace M = {0} of U is called 
irreducible if it contains no non-trivial (4 {0}) subspace which reduces U. 


Lemma 2.1 (Halmos [2]). An invariant subspace M> {0} of U is 
irreducible if and only if there esiste a function fu(p) EL? such that 
| fo(d)| —=1, 

(2.1) M = M (fo) = fo (p) - L*. 


The function fo($) is unique up to a constant factor of absolute value 1. 
If f(¢) € L’, M(f) is the subspace 
(2.2) M(f)=elm. (F, fe, fer, - - 7 


spanned by f,fe®,- - +. In (2.1), fo(¢)-L* denotes the set of functions 
f($) of the form fo($)2*($), where z’($) € L”, 
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THEOREM 2.1. Let Of (p) €L’. Then M(f) is irreducible if and 
only if F($) 0 and 
(2.3) log | f(¢)| € Z*3, 


this is the case if and only tf f(&) has a factorization 


(2.4) fe) —fold)fit(o), where | fo(p)| 1 


and f,*(@) is an outer function in the sense of Beurling. In the factorization 
(2.4), fo($) is unique up to a constant factor of absolute value 1. Further- 
more, M(f) = M (fo). 


Before beginning the proof, several definitions will be recalled. Let 
(2.5) a($) ~ I ayeiné 


be of class L!. The conjugate function 8(¢) of «(¢) is the function defined 
by the Abel sum of the series 
(2.6) Bl) ~— iÈ ment iS a nein 

n=l 


n=1 


or, equivalently, by the principal value 
2r 
B$) = EPV | 200) cot (G—0) 9; 
cf. [12]. If a(¢) is real-valued (i. e., an = än) and 
D Ale) at f, aa) (eta) (er), 


then A(z) is regular for |z| <1 and A(re#) >a(¢) +78(¢) asrol. A 
regular function F(z) on |z|<1 is called an outer function if there 
exists a real-valued function a(¢) EL! and a real constant œ such that 
F(z) =exp(A(z) +ie). (In particular, an outer function does not vanish 
for |z|<1.) Correspondingly, the boundary function f*(¢) —F(e!%) 
=exp[a ($) +%48(¢) + ta] will be called, an outer function. A function 
F(z) regular for |z| <1, | Fo(z)|<S$1 and | Fo(e*)|—=1 will be called 
an inner function. Correspondingly, the boundary function f,*(¢) == F, (ett) 
is called an inner function. (Thus f,*(#) is an inner function if and only if 
fo ($) € Z* and | fo(#)|—=1.) 

Let 054F'(z) € Hr for some p > 0, i.e., F(z) is regular for |z| <1 and 
S| F (ret) |Pdp < const. <œ for 0 <r<1. Then a(¢) =log | F(e*)| EL; 
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F. Riesz [6]. The outer function F,(z) = exp(A(z) +i«) satisfies | F(z)| 
S| F,(2)| and | F(e*)| = | F, (ett) |. Hence there exists an inner function 
F(z) such that F(z) =F o(z)F,(z); Beurling [1]. This or the corres- 
ponding factorization of the boundary functions ft ($) = fo($)f:*(¢) will be 
called a factorization of F(z) or f*(#) into inner and outer functions. This 
factorization is unique up to constant factors of absolute value 1. 

Note finally that if F,(z) and f,*(¢) = F,(e#) are outer functions, then 
so are the reciprocals 1/F,(z) and 1/f,*(¢). Also, for a fixed p> 0, 
F,(z) € Ho if and only if | f:*($) | =e € Ir, 


Proof of Theorem 2.1. Suppose first that M(f) is irreducible. Since 
f(¢) € M(f) = M (fo), it follows from Lemma 2.1 that f($) has a representa- 
tion (2.4) where f+ (p) € L**. Since | ft(¢)| =| f(¢)| € L>, it follows that 
log | ft()| € L*; Szegö [9] (or the F. Riesz [6] result mentioned above). 
Hence (2.3) holds. This proves the “only if” assertions. 

Suppose that f(¢) € L? satisfies (2.3). Then |f()|?¢€ Z* and (2.3) 
imply (Szegö [9], p. 235) that |f(#)|? has a factorization 


(2.8) LEC) = fit (@) lA) ICH 


where f,*(¢) € L** is the outer function which is the boundary function of 
F,(z) =expA(z) and A(z) is given by (2.7), a($) =log|f(#)|. Since 
[f(¢)|—=|fit(#)|, the factorization (2.4) follows. (This corresponds to 
the factorization given by Beurling in the case fe L**.) 

Thus in order to complete the proof of the “if” assertions, it suffices to 
show that when f(¢) has a factorization (2.4), then M(f) == fo()-L*. 
But this follows from | fo(¢)|=-1 and the Beurling result: M(f,*) == L” 
for outer functions f,*(¢) € L*. 

The uniqueness of fo($) is contained in Lemma 2.1. This proves the 
theorem. 

For later purposes, another representation of the factorization (2.4) 
will be given. By the theorem of Szegö [9] used above, |f($)| has a 
factorization 


(2.9) IEC) = fa (HRA) = ICH 


where fs*($) is an outer function and, in fact, can be chosen so that 
fit (p) = [fa*()]*. One then obtains the factorization (2.4) with fo($) 
given by 


(2.10) fo($) = (F(4)/| FON) (fat (4) /fa* (4) )- 


8. The subspaces N(f). Let P denote the orthogonal projection of 
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L? onto L* so that, in terms of (1.1) and (1.8), Pf(¢)=f*t($). For 
f(#) € L’, introduce the subspace 


(3.1) - N(f) = closure of PM (f) 


of L?+, There will be derived conditions in order that N(f) =L*. A com- 
plete characterization of N(f) (for example, as Lemma 2.1 gives for irre- 
ducible M(f)) will not be obtained. 

Before dealing with the question, a motivation for the consideration of 
N(f) will be given. For a given f€ L?, T(f) is an operator from L* to L*. 
Its domain D(T) is the set of all 2(¢) € L* such that if yt(¢) +4°(¢) 
=f (p)a*(), then y*(¢) € L* and y($)=T(f)z*(6). Roughly speaking, 
T (f)2*(¢) = Pf(¢)2*(¢), where however f(¢)a*(#) € L is not required to 
be in L°. Let T,=T,(f) be the restriction of T with domain D(T7,) con- 
sisting of trigonometric polynomials 2*(¢) € L**. Thus N(f) is the closure 
of the range of To(f). Also To*(f) = T (F), i.e the adjoint of T, (f) is T(P). 
The adjoint 7*(?) of T(f) is the closure of T,(f). Thus 


(3.2) THEMEN, T*(f)=T(f). 


Since the null space N (T*) of the adjoint T* of a closed operator T is the 
orthogonal complement of the closure of the range &(T) of T, one has 


Lemma 3.1. Let f($)EL?. Then N(f)L=N(T(f)), where N(f)4 
is the orthogonal complement of N (f) in L*. 


In particular, if g(¢) € L? is real-valued, then J*(g) is a closed, sym- 
metric operator and 


(3.3) g = j> To(g) C T*(g)C T(g) = T** (g) 


ef. [4]. Thus, the deficiency indices of T*(g) are the dimensions of 
N(T'(g++)) or, equivalently, the dimensions of the co-spaces of the closure 
of the ranges of T,*(g +1), ie, dim N(gzzi)t. This gives the following 


LEMMA 3.2. Let g($)EL!($) be real-valued. Then T(g) 1s self- 
adjoint tf and only if N (g +1) = L**. (In which case, the operators T (g + 4) 
are invertible, i.e., have unique, bounded, left and right inverses.) 


Remark. If h(¢) € L?, then g(#) € L* is orthogonal to h(d)e*? for 
n=0, +1,- - - if and only if h(¢)g(¢) 0. Thus, as observed in Sarason 
[7], the smallest subspace of L? which reduces U and contains h(#) (i.e. the 
subspace of L? spanned by h(¢) 6!" for n—=0,+1,-- -) consists of the set 
of functions in L* which vanish on the ¢-set where A(#)=0. It has been 
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pointed out to me by Sarason that this fact implies that if M(f) ts. not 
irreducible, then N(f) —=L*. For suppose that N(f) >£L*, then there 
exists an h*+(d) € L?* which is orthogonal to N(f) and, hence, to M(f) and 
ht(@) £0. Let Myy4{0} be a subspace of M(f) which reduces U, then 
h*($) € Mot, the orthogonal complement of M, in L?. Since h*(¢) 40 almost 
everywhere by a classical theorem of F. and M. Riesz, the remark at the 
beginning of this paragraph implies that the subspace Myl which reduces U 
and contains h*+(¢) is L?. Hence M,—.{0}. This contradiction proves the 
italicized statement. 

Thus, in dealing with the subspaces N (f), it will be ee, that M(f) 
is irreducible. It suffices, therefore, to consider only N (fo), where fo € L* 
and |fo(¢)|<=1. Whenever convenient, the notation fo, fit, fs* of (2.8)- 
(2.10) will be used. 


4. Conditions for N(f) =L**. The results will be stated in this 
section. Their proofs will be deferred to the following sections. 


“THEOREM 4.1. Let f() € L* and log|f(p)|€L*. Necessary and suffi- 
cient conditions for 
(4.1) 6o(¢) ==1€ PM (f), 


(hence, sufficient conditions for N(f) = L) are the following equivalent 
conditions: 


(i) there exist inner and outer functions zo (p), t+ (6) € L** such that 
foe($) ts representable in the form 


(4.2) fol) =Z (Hr (p) /as* ($); 


(ii) there extsis an inner function 2 (6) € L?* and a function 
6(b) =arglf($)20’($)] which has a conjugate function y($) € L> satisfying 


* (4.8) | WO | F(E) | ETA. 
The condition (4.1) is not necessary for N (f) = L*. 


The validity of the parenthetical assertion following (4.1) is clear; cf. 
Section 5. In fact, much of the following is based-on the fact that N (f) = L* 
if and only tf (8) E N(f). 

Note that in (ii), it is not stated that 6(¢) € Z*. Condition (ii) should 
be interpreted in the sense that there exists a real-valued y(¢) € L* satisfying 
(4.3) and having a conjugate function —6(¢) =—arg[f(¢)20*(¢) ]. 

An immediate consequence of Theorem 4.1 is the following: 
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COROLLARY 4.1. Let f(b) EL? and log|f($)|E L!. A suficient con- 
dition for N (f) =N (F) = L* is that there exists a function 6(¢) = arg f($) 
which has a conjugate function y (p) € L satisfying 


(4.4) al¥Ol | f(g) | € ZA, 


If, in addition, it is assumed that 1/f(¢) is bounded, then, as will be 
seen in Section 6, the condition on the existence of #($) =argf($) in this 
corollary is necessary and sufficient for &($) € PM(f) N PM(F). This gives 
the following: 


COROLLARY 4.2. Let f(¢) and 1/f(¢) be bounded and measurable l 
functions. Then e(¢)€ R(T(f)) N R(T(f)) if and only if there emists 
a function 6(¢) =argf($) having a conjugate function y(p) € L! satisfying 


(4.5) AKOE Li. 


In this case, there exists a unique (up to a multiplicative constant) outer 
function zı* (p) such that a4*, 1/a,*€ L* and f($)/| FO) | =t (¢)/ts*(9). 

In Corollary 4.2, the condition (4.4) is necessary for T (f) to be inver- 
tible. A necessary and sufficient condition is that the matrix which is the 
formal product T(z*)T(1/&*) be bounded; cf. [4], pp. 871-873; for an 
interpretation of this matrix product, see Widom [11]. 


Remark 1. It will follow from Theorem 4.2 that if (4.1) holds, then 
a necsesary condition for A==0 not to be in the point spectrum of T(f) 
(i.e., a necessary condition for N (fe) —L**) is that f)(¢) have a represen- 
tation as in (i) with zo’($) =1. This condition is not sufficient; cf. Remark 
3 and its proof. (Note that although N (f) =N (fo), it is not necessarily 
true for unbounded f that V(f) =N (fo).) 


Remark 2. The relation (4.1) is equivalent to e.(¢) € R(T (fo)), the 
range of T(fo). A modification of the proof of Theorem 4.1 shows that 
eo(ġ) € R(T(f)) if and only if (ii) holds with (4.3) replaced by 
(4. 6) (| f(g) | € Lt. 

The relation eo(ġ) € R(T(f)) is equivalent to a representation a fol) in 
the form (4.2) and of f(¢) in the form 

(4.7) Fie) (e) =F ($). 

where æt (p) € L**, y*(¢) € L=. If AO is not in the point spectrum of 


T(f), then a +(¢) can be chosen to be 1 (i.e, 6(¢)argf(¢)) in this 
necessary and sufficient condition. 
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The sufficient condition (4.3) for N (f) = L*, but not for (4.1), can 
be lightened somewhat. 


Lemma 4.1. Let f(¢) EL? and log|f(¢)|¢€ I+. A sufficient condition 


for N(f) == L* is that there exist an inner function x *(¢) and a 0(¢) 
= arg[f(¢)2o*(¢)] having a conjugate function w(o) € L! satisfying 


(4.8) AO | f(g) BE Lt and eM | F($)| € Lt for p <1, 


(4.9) f Treno fs ote |f) dp as > +0. 


A necessary and sufficient condition for N (f) == L™ can be deduced from 
the following 


THEOREM 4.2. Let f(p)€L? and log|f(¢)|€L'. Necessary and 
suficient for N(f) 4 L* (i.e. for A==0 to be in the point spectrum of T(f)) 
are the following two equivalent conditions: , 


(i) there exists a non-constant inner function xọ(p) and an outer 
function zı*($) € L= such that fo($) is representable in the form 


(4.10) fop) = zo (p) (1/2 ($) / War ($)) 5 

(ii) there exists a non-constant inner function z,'(6) and a 6(¢) 
==arg[f(p)Z'(p)] having a conjugate function y(¢) € L> satisfying 
(4.11) e¥/| (4) € LA. 


If (i) and/or (ii) holds, 1 + dim N (fo) L is at least as large as the number 
of linearly independent divisors of zot(¢). 

An inner function yo*(#) is called a divisor of so (¢) if there exists an 
inner function 20*($) such that zot(p) =Yyo*($)20*($) ; Beurling [1]. For 
example, if zot (p) = e*™4y,+(¢), where m > 0 and y0*($) is an inner function 
(possibly &($)=1), then 1,6'%,- - -,em® are divisors of a*(¢) and 


dim N (fo)+ = m. 
Note that (4.10) is equivalent to a representation for /)(¢), 
(4.12) Polg) =Z ($) Es" (4) /z* (4); | 


analogous to that of (4.2) for fo($). 


In order to state the next theorem, introduce the following notation: 
For an inner function &,*($), let M,(xo*) be the closure in If, 1= pw, 
of the linear manifold spanned by 2 *(¢)6*"*, n == 0,1,: - - and let M,(z*)1 
be the orthogonal complement of M,(z,*) in L*, 1/p + 1/q =1. 
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COROLLARY 4.8. Let the condition (i) of Theorem 4.2 hold and, in 
addition, let 1/21*() € L? (or equivalently, let (ii) and, in addition, (4.3) 
hold). Then N(fo) t= N(T(f)) is given by 


(4.13) NT) = {2 (p) € L: s (p)/z ($) E€ Meo(a0*) +} 5 


that is, N(T(F)) =L*N {2+ ($):Me(2)L}. (For example, if zo (¢) 
== eme, then dim A (T(F)) =m.) 


Remark 3. This corollary becomes false if the assumption 1/r,*($) € L? 
or (4.3) is omitted. The difficulty arises from the fact that in the represen- 
tation (4.10), the outer function zı*(&) € L** is not unique up to constant 
factors (even if z,* is fixed). (If any representation (4.10) exists, however, 
with w ‘(¢) an inner function and 2,*(¢) € L** an outer function such that 
1/a,*() € L*, then the functions x, z,* are unique up to constant factors. 
It will be verified in Section 8 that a necessary condition for œ > dim N(f,)+ 
== m > 0 is that fo(¢) have a representation (4.10) (i.e. fo($) have a repre- 
sentation (4.12)) with zot (p) = 6"? and 2,*(¢) € L** on outer function. 
But this condition is only sufficient for dim N (f,)L = m, and dim N (fo) t > m 
can hold. 


Theorem 4.2 and its proof imply the following: 


Conornary 4.4. Let f,($),fa($) € L°, log| fi(¢)|€Z4, f2($)/fi($) 
real-valued, and f2(¢)/f:1(¢)2=¢>0. Then dimN(T(f:)) S dim N(T(f,)). 
In fact, if at(p) EN(T(fı)), then a ($) fast ($) /faa* ($) € N(T (fe) ), where 
fists fest belong to fi, fa, respectively, as f:t belongs to f in (2.9). 


This, in turn, will be seen to have the following consequence: 


Cororzanr 4.5. Let fi($), fe(p) € L3, log | fi (p) | € LM, and f2($)/f:(¢) 
real-valued and 0 <<cSfz(¢)/fi(o) SC. Then T(fı) is invertible if and 
only tf T'(f2) ts invertible. 


Theorem 4.1 will be proved in the next section and Corollary 4.2 in 
Section 6. The proof of Lemma 4.1 will be given in Section 7. The next 
section, Section 8, contains the proof of Theorem 4.2, Corollary 4.3 and 
the Remark 3. Finally, Corollary 4.5 is proved in Section 9. 


5. Proof of Theorem 4.1. Suppose first that e)(¢)€ PM (fo), ie. 
there exists a z*(¢) € L* such that 


(5.1) fold)a*(b) =F ($) -o*($) 1+ yr +> el. 
Then z*(#) and y*($) have factorizations # = 2*z,*, y'=Yo'yı* into inner 
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and outer functions in Z*. Since | zı* |= | Yı* |, the outer functions z,*, y.* 
differ only by a constant factor of absolute value 1. It can be supposed there- 
fore that 2, =— y,* (by suitably modifying 2,* if necessary). Thus (4.2) holds 
with 20 ($) = yo" (6) /Z0() =y" (p)z (p) and w*(p) =y:+ ($). Hence, 
(4.1) > (i). 

Let (4.2) hold and let 


(5.2) T+ (p) ~ do + die? +--+, where dy 0. 
Then (5.1) holds if 
(5.3) z (p) — To (p) T1* ($) /do. 


i.e, (i)> (4.1). Thus (4.1) and (i) are equivalent. 


From (4.2), it follows that fo($)2.*(¢) —4'($)4:*($). Hence it is 
clear that M (fo) = M (Zo'é,*) and that N (fo) = L. This gives the paren- 


thetical part of the theorem to the effect that (4.1) is sufficient for N (f) = L**. 
It will now be shown that (i) => (ii). From (4.2) and (2.10), 


(5.4) Go" ()F(b)/| f(b) | = [Et (e) /Fa* p) ILe (4) /fa* () J. 


Since 2,*(¢)/fst(¢) is an outer function, there is a real-valued function 
y(¢) € L having a conjugate function —#($) such that 


(5.5) Tt (p)/fa (p) N, 


so that 0(¢) =arg[f (p) ($)]. Also | 21*(p) |?—= e | fat (H) |? — e | 7(4) | 
is of class Lt. Consequently, (i) > (ii). 


Conversely, if (ii) is assumed, then 


(5.6) zo (b)F(¢)/| FAT = H ($) /91 (4), 


where y;*== #49 is an outer function such that |y,*|*|f|¢Z*. Hence 
Tı* == 4,*f,* is an outer function of class L**. This gives (5.4) and hence 
(4.2) by (2.10). . . 

In order to see that (4.1) is not necessary for N(f,) = L+, let fole) 
be a real-valued function assuming the values + 1 but is not a constant almost 
everywhere. Then [4, (iii)] implies that &($) EN (fo); i.e, (i), (ii) do 
not hold. But N (fo) — L** for otherwise, A= 0 is in the point spectrum of 
T (fo); Lemma 3.1. But, since ff, is bounded, the point spectrum of 
T (fo) is empty by [4, (ii)]. This completes the proof of the theorem. 


6. Proof of Corollary 4.2. Instead of proving the corollary directly, 
the more general statement preceding it will first be proved. That is, if 
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f() € L? and 1/f(¢) is bounded, then e.(¢) € PM(f) N PM (f) if and only 
if there exists a 9(¢) =argf(¢) having a conjugate function y(¢) € L> 
satisfying (4.4). (The uniqueness statement at the end of Corollary 4.2 will 
follow from the proof of this statement: ) 

By the proof of Theorem 4.1, &($) € PM(f) if and only if there exist 
inner and outer functions 2,*,2,*€ L** such that (5.4) holds. Similarly, 
6 (6) € PM (F) if and only if there exist inner and outer functions yo*, y,* € L** 
such that 


(6.1) yor (b)F(H)/| Fb) | = Bt (6) /Fat (6) 1/Lys* (8) /fa* ($) J. 


When (5.4) and (6.1) hold, a multiplication of these relations gives 


(6.2) z (p)z* ($) =Z ($), 
where 
(6.3) ` gt = Tyo and z = (21*/fa*) (Yyır/fr) 


are, respectively, an inner function and an outer function of class L**, since 
1/fs* is bounded. It follows that both sides of (6.2) are constants and, 
since the only inner function which “ divides” a constant is a constant, Tot 
and yọ are constants. Thus in (5.4) and (6.1), it can be supposed that 
Zot ==1, yot—=1 and 4,*=1. Thus if (5.5) holds, then 


(6. 4) Y (p) /fat (p) N, 
Consequently, 6% | f |€ Lt, i.e, el¥l| fle Li. 


Corollary 4.2 follows from the fact that PM (f) =R (T(f.)) and that, 
when f and 1/f are bounded, R (T (fo)) — R (T(f)). For example, T(f.)a* 
—yt if and only if T(f)[2*/fit] —y*. This completes the proof. 


7. Proof of Lemma 4.1. The assumptions of the lemma show that 


(7.1) 610) — (f(b) /| FCA) |z (e) =7 (p) /a*(4), | 
where zt(p) = e+ is an outer function. Hence, by (2.10), 
(7.2) folg) — ao" ($) Z (#) Fat ($) /2* (4) fa" ($). 


Since | fa*(¢)| =| f(¢)|4, the first assumption in (4.8) implies that 
z’(#)fs*($) is an outer function of class L**. In particular, 


(7.8) en SFr) exists and 0. 
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ar 
(7.4) com (2a) -f ET 


Note that the outer function z*($) is the boundary function of an outer 
function F(z) which is regular and does not vanish for |z| <1. Hence 
(a*(@))* can be taken as the boundary function of (F(z))* which is uniquely 
detremined up to a factor e?"#r/e independent of z. It will be supposed that 
this determination is chosen so that 


(7.5) EHO) — (E*() )*/(a*(p) )* 
where (Z*(¢))¢ is the complex-conjugate of (a*())*. Also, (z+ (p)) = in 
(7.4) and below is defined as z’(#)/(z*($))“. 


The integral in (7.4) exists. In fact, the absolute value of the integrand 
is et0-¥|f,*| which is majorized by (e+ 1)|fl#e Z. By Lebesgue’s 
` theorem on dominated convergence, 


(7.6) Ce—> Co(£0) as e> + 0. 
Define fe(@) by 
(7.7%) Fel) = fo (p) e-*9@, 
Hence (7.2) and (7.4) show that 
(7.8) Feld) ¥e($) = (P(A) F ($) H °°, 
where 
(7.9) Yelp) = Lo" (p) (er (p) Fer (p) /be 


is of class L* by (4.8). The relation (7.8) gives T (fe)ye— eo(¢). Hence 
lT (fo)ye— eo(¢) |] = | (T (Fo) —T (fe) ) ¥e | S ll Go — fe) ye l 
By (7.6), (7.7) and (7.9), the condition (4.9) means that 
I (fo— fe) Ye ||? +0 as «> 0. 


Hence @(¢)€N(f), the closure of the range of T(fo). Consequently, 
N(f) =L”. , 


8. Proof of Theorem 4.2. Since the proof of the equivalence of (i) 
and (ii) in Theorem 4.2 is the same as in Theorem 4.1, only (i) will be 
considered. 
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It is easy to see that O04 v*(¢) € L* is in N(fo)+ if and only if fyv* 
is orthogonal to L*, i.e., : 


(8.1) Folp)ot (p) = EB (p), where wt (p) ELF, 


Arguing as in Section 5, one obtains from (8.1) a representation of the form 
(4.10) in which 2*(¢) has the divisor 6t. 

Conversely, let fo(¢) have a eher (4.12) with 2,($) £ const., 
let (5.2) hold, and zot (p) ~ cnet"? +--+ with „0, m20. If m>0, 
then A==0 is in the point spectrum of T (fo); 3 in fact T(fo)ay*(¢) = 0. If 
m= 0, then 


Fole) (e) =F (p) y (p) ~1 + ye + E 


holds with z*(¢) =z*(ġ)/ĉodo and also with (5.3). Thus 7'(f,)z*—=1 has 
two linearly independent solutions, so that X==0 is in the point spectrum of 
TR). 

Tf yo, 20* are divisors of z, and zo ==Yo*'2o*, then (4.12) implies 
Foyotts* == Z'*. This makes it clear that if z,* has m linearly independent 
divisors, 1< moo, then (8.1) has at least m—1 linearly midependent 
solutions v*($). 


Proof of Corollary 4.3. If z($) € L* is in N(fs)+, then the scalar 
products (fop*,x*) vanish for all trigonometric polynomials p*(6) € L*. 
Since 1/z,*(#) € L** is an outer function, M (fo) =M(fo/zı*) and (fop*,x*) 
= 0 for all p* if and only if ((fo/zı*)p*, =) — 0 for all pt. In view of (4.10), 
this is equivalent to (zo’p*, 2*/x,+) =0 for all p. Hence te L? is in N (fo)+ 
if-and only if /zı* € M.,(a*)+. 


Proof of Remark 3. If 04 v'(¢) EN (fo)t, ie, if (8.1) holds, let 
ettwt (p) ~ wrot? + we et@t? +. - -, where wp 0 


and k>0 is an integer. The integer k will be said to belong to the ele- 
ment v*(¢?) €N(f.)t. If dim N (fo) =m >O, then there is an element 
v (p) € N(fo)+ such that m belongs to v*($). In this case, (8.1) leads 
to a representation for fo($) of the form 


(8.2) Fo(p) = et "Pit (pb) Tt (p) /a1* (4), 


where 2 *, @,* are inner, outer functions in L*. Arguing as in the proof 
of Theorem 4.2, w*() s£const. implies that dim N (fo) >m; ie, if 
dim V(f,.)L—m>0, then 29*(¢) ==const. This proves the first part of 
Remark 3. l 


72 PHILIP HARTMAN. 


In order to prove the last part note that if 

(8.3). grile) = i+e%, rl, 
then 2,*, y:* are linearly independent, bounded, outer functions and, as is 
easily verified, £,*/2,— Yı'/yı*. For a given m= 0, let 

fo ($) = emezt mt É etmog t/y. 
'Thus fe(¢ġ)} has representations of the form (4.12) with z*(¢) =e. But 
if m> 0, then dim N (fo)- > m for it contains the 2m elements v* == erkör,* 
and vma ey,+ for k=0,1, ",m—1. Also if m—0, dim N (fo) > 0 
for it contains vt== yt — in‘. Actually, dim N (fo) =œ as can be seen 


by using the formula 
Jole) eat ($) /z* ($), 


where 2,'($) = (2+ (4) ) (y ($))5 0Sa £1, and (m*(6))%, (ys"($))** 
are the boundary functions of (t+ 2)®, (1-+%z)*% which reduce to er“, 1, 
respectively, at z—0. 


9. Proof of Corollary 4.5. For any fe L°, T(f) is a closed operator 
since it is the adjoint of 7,(f). Thus, 7'(f) is invertible if and only if it is 
one-to-one (i.e, dim (T(f)) =0)) and onto (i.e, i (L(f)) =L**). 

Corollary 4.4 shows that T'(f,) is one-to-one if and only if T (fz) is 
one-to-one. Thus, the corollary will be proved if it is shown that if T(f:), 
T(f,) are one-to-one and T(f,) is invertible, then T(f,) is invertible. This, 
to be proved under the assumption that there is a function A($) such that 


(9.1) hl) = h(a) fi ($), 
0<cSh(o) SC. 
This proof will depend on the following simple lemma. 


Lemma 9.1. Let ot(d) € LP and f($) € LY, where 


(9.2) p++. 
Then 
(9.3) To) T(f)T (ot) and T(E) TT). 


Cf. Widom, [11], p. 94, where p= q==œ. The first of the relations 
is clear. The second follows from the fact that if r*(¢)¢Z**, where 
piri, then ot($)r*(p) € IM. 
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There exists an outer function hs*($) such that hat, 1/het€ L** and 


(9.4) Alb) = hat (ö)har(b); 

cf. (2.9). Hence l 

(9.5) fald) = hat (p) fa (p) hat (4) - 
and, by Lemma 9.1, 

(9.6) T (fa) D T (hat) T (fr) T (hi). 


The product on the right of (9.6) has the bounded inverse 7'(1/hs*) [T (f) ]* 
T(i/hs*). In particular, its range is L**. Since T(f,) is one-to-one, it 
follows that “D” can be replaced by “=” in (9.6). Hence T(f,) is 
invertible. 


10. Self-adjoint T(g). In view of Lemma 3.2, the results of Section 4 
applied to f=g-+1 give criteria for the Toeplitz matrix T(g) of a real- 
valued g(¢) €L? to be or not to be self-adjoint. These results can be 
summarized as follows: 


Let g(¢) € L? be real-valued. Then 

(*) T(g) is self-adjoint if there exists a d($) =— arctan 1/g(¢) having 
a conjugate function y($) € L! satisfying 
(10.1) eKO + | 9(¢)|) € Dt; 


(**) the deficiency index dim N (T (g—+)) =0 if there exists an inner 
function z,'(6) and a #($) = arctan 1/g ($) + argao*(¢) having a conju- 
gate function y($) € Z* satisfying 


(10. 2) HO (1+ | 9(¢)|) EL 

or more generally, 

(10.3) EL + | g($)|) €T for 0<e <1, 
tr 

(10.4) f Ties rem + |g|)dp->0 as 0. 
0 


If (10.2) holds and, in addition, sot ($) const., then T(g) is maximal 
symmetric with im (T(g+-4)) >0; 

(***) the deficiency index dim N (7'(g—+)) > 0 if and only if there 
exists a non-constant inner function 2*(¢) and a @(¢) = arctan 1/g(¢) 
—arg2,*(¢) having a conjugate function y(¢) € L satisfying 


(10.5) o¥/(1+]9($)|) € LA; 
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in which case, dim N (T (g —i)) =m—1 if there exists at least m linearly 
independent inner functions which divide z.*($). (If, in addition, (10.2) 
holds, then Corollary 4.3 is applicable to f—g(¢) +1.) 


(****) T(g) is self-adjoint if and only if T(gh) is self-adjoint, where 
h($) is a real-valued measurable function such that 0 < eSh(o) SC. 

In order to verify (****), note that the dimensions m, n of the null 
spaces of T'(gh + i) are the same as those of T (g +1/h) =T(g) +iT(1/h); 
Corollary 4.4. Since T(1/h) = [T (het) T*(h*) | in the notation of (9.4), 
m and n are the dimensions of the null spaces of 8* = T*(h,+)T(g)T(hs*) + 4. 
Thus m, n are the deficiency indices of the closed, symmetric operator 
S — T* (hat) T*(g)T (h:t). Since these deficiency indices are the dimensions 
of the largest subspaces modulo D(8) on which Im(S*z*,z+) 20 or S0 
(cf. [5], p. 149) and (S*2*, zt) — (L(g) T (hat) at, T(hz*)z*), it is seen that 
these deficiency indices are the same as those of T*(g). 

In the remainder of this section, illustrations of the use of (*)-(***) 
will be given. 

(a) It was pointed out in [4] that if g(#) € L? is half-bounded, then 
T(g) is self-adjoint. It will be indicated how this also follows from .(*). 
Without loss of generality, it can be supposed that g(¢) =c> 0, where c 
can be chosen so that 9(#) = arctan 1/g(¢) satisfies 0<06(¢) =}. Then 
the conjugate function y(¢) is such that el¥l€ L3; [12], p. 164, Exercise 3. 
Since g € L°, (10.1) holds and hence, 7'(g) is self-adjoint. 


(b) In order to obtain examples of g(¢) € LZ? which are not half- 
bounded but for which T (g) is self-adjoint, it suffices to choose g($) € L*, so 
that #(¢) —=arctan1/g(¢) has a continuous determination. Then 6(¢) has 
a conjugate function y(¢) such that el¥l € L? for all p; [10], p. 358. Thus 
(10.1) holds and T'(g) is self-adjoint. For example, let g($) be periodic of 
period 2r and continuous except at a finite number of points ¢—¢1: ` `, dx 
mod xr and g(¢;-+ 0) =g(¢;—0) is +% for ja1,---,k. 


(c) Let g(¢) € L? be real-valued and extended as a periodic function of 
period 2r. Let there exist a finite number of points ¢1,: * +, pr dit," * -y Pmt, 
Ps ` *,¢n mod 2 such that g(¢) is bounded outside of neighborhoods of 
these points; g(¢) is continuous on punctured neighborhoods of these points ; 
both limits g(¢ + 0) exist, possibly +, at these points; one of the limits 
9 ($j +0) is finite for j =1,- - -,k; g(¢) jumps from —o to +o at ddr 
for j=1,: ‚m and jumps from œ to —o at p= ¢r for IL en, 
It will be shown that (i) if m—0, then dim (T(g—i)) =0; hence (ii) 
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if m =n = 0, then T(g) is self-adjoint; (iii) if m&r > o0 and if for some 
p>, the function 1/|9(¢)(¢—€)|? is integrable for & near fm gy, 
j=l, : -,n, and L— dj for r choices of j, 1S jm, then T(g) is not self- 
adjoint and dim” (T(g—t)) 2r>0; (iv) tf 1/g($) is uniformly Dini 
continuous on every small interval [E— e, E); (mn +€] where | g(€—0)| =% 
and | g(y+0)|—oo, then dim” (T(g—4)) —m and dim N(T(g + t)) =n. 

A function is called uniformly Dini continuous an an interval if it has 
a degree of continuity »(8) such that Í. èto (8) d8 <. 

The proofs of (i)-(iv) depend on a device of Widom [11]. It wil 
remain undecided whether or not T (g) can be self-adjoint if either m > 0 
or n>o0. í 

In order to prove (i) and (iv), let 0(¢) —arctan1/g(¢), OS Sr. 
Note that if go(¢) is a bounded, measurable, real-valued function, then T'(g) 
and T(g + go) =T(g) +7 (go) have the same deficiency indices since T (go) 
is bounded and self-adjoint; cf. [5], p. 150. Thus, it can be supposed that 
g(¢) is continuous except at d= ¢;, p; and that if Ara, is the jump of 6(¢) 
at py, then 4|a;|<1. For otherwise, g is replaced by g + go for a suitable 
choice of go. 

Let y(¢) = p — 2% [¢/2r], where [z] is the integral part of z, denote 
the continuous periodic function which is ¢ on 0<¢ < 2m and has a jump 
of — 2r at $=0mod®r. Then 


r($) ~r—i Y, ett? /n, 
n0 


so that its conjugate function is —2log | 1— e* | and 


(10.6) u($) —8(9) + Band) 47099) +43 7(¢—47) 


is continuous. Consequently, if v(&) is the conjugate function of u(¢), then 
ell € Le for all p. (Also, if u(¢) is, for example, uniformly Dini con- 
tinuous, then v(#) is bounded.) 

On (i). Suppose that m—0. Then the conjugate function of 6(¢) 
= arctan 1/g(¢) is 


; : 
vd) = vlg) +2 E alog | 1 — ett | + Slog [| 1—etle#s) | +0 
ja ja 
for some constant O. Hence 


E : 
EE) — oer) TI | 1— etn) > TI | 1 — ren) |. 
J= j=1 
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The last product is bounded. Since 2]|a,| <4 and elle Ze for all p, it 
follows that e¥ € L°. Thus (10.2) holds when 2,*(¢) == 1 and so, (i) follows 
from (**). 

On (iii). Assume the conditions of (iii) and suppose that the enumera- 
tion of the ¢;* is chosen so that the first r points ¢,*,-- ',d,* have the 
specified property. Write (10.6) as 


ie) Iren 
(10.7) j=l jer+l 


+ Sy (¢— )) +3 př, 


where ĉi’ ",&rım is the set of points ¢,*,---,¢r', 15° 9 dm and 
9o(¢) —O(b) = O mod 2r is the sum of 2r[(¢— ¢j*)/2r] for j—1,°- -, 1. 
The relation (10.7) is obtained by writing the factor — 4 of y(¢—¢y,*) in 
(10.6) as —1+4 for j—1,---,r; ef. [11], p. 95. Then the conjugate 
function of 6)(¢) —r¢ = arc tan 1/g(¢) — arg et"? is 


y(p) = v(p) 4.2 Saylog | 1— et(¢-4y) |- È log | 1 — #49) | 
j=1 =r+1 ; 


+. Flog |1— ek) | +0. 
ja 


Hence 


k m rim 
WO mm CeO T] | 1— en | IT | 1 — ete |/ T] | 1— ett- |. 
j=l garth jal 


Since 6) € Le for all p and 2 | a; | < 4 < 1, the assumption on g($) in the 
neighborhood of ¢;==¢1*,- * °, Pr, dry © "dm implies that (10.5) holds. 
Thus (iii) is a consequence of (***) where zot (a) = 6*9. 

On (iv). It is clear from the proof that, in (iti), “some p >1” can be 
relaxed to “p=1” if v() is bounded. This fact will be used in the proof 
of (iv). 

The function ($) —arctan1/g(¢), 0S0 =, is uniformly Dini con- 
tinuous on the intervals occurring in the statement of (iv). Thus, after 
the addition of a suitable bounded function to g(¢), it can be supposed that 
u(¢) in (10.6) uniformly Dini continuous. Hence its conjugate v(¢) is 
continuous and, a fortiori, bounded. 

If (ô) is a degree of continuity for 1/g(¢) on one of the specified 
intervals, say [é— e, £), then | 1/g(¢)| So(€—¢) foré—eS¢<é Hence 


Sa (8-01 fi oaa. 
ge de 
Similarly, 1/| g ($) (¢—7)| is integrable over the interval (7,7 +e]. 
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Thus dim A (T(g—i)) 2m follows from the proof of (iii) and the 
remark at the beginning of this proof. In fact, dim? (T(g—i)) =m is 
a consequence of Corollary 4.3 where the analogue of (4.12) holds for 
f=g(6) +1 with x*(¢) = 6$ and, up to a constant factor, l 


K m 
Tt ($) = g4) TT (1 a er) TL (1 n ee Fr, 
j=l jal 


where {; rung through ¢/*; so that 2,*,1/2,* € L*. 


Addendum. C. R. Putnam [Pacific Journal of Mathematics, vol. 9 
(1959), p. 838] proved the following: (I) Let g($) € L* be real-valued and 
even, so that g(p) ~E gne"? = go +2 Dgncosnd, where Jn =s 18 real. 
If the Hankel matric H (g) = (Jum), where n, m == 0,1,2, ` -, 18 bounded, 
then T(g) is self-adjoint. Putnam has pointed out to me that, in view of 
Nehari’s necessary and sufficient condition for an infinite Hankel matrix-to be 
bounded [Annals of Mathematics, vol. 65 (1957), pp. 158-162], (I) takes the 
following form: (II) Let g(¢) be as in (I). If there exists a function 
h’($) € L* such that g*($) + h*($) is bounded, then T (g) is self-adjoint. 

It can be mentioned that Putnam’s observation (I) has a very simple 
proof: If g(#) € L? is real-valued and L(g) is the corresponding Laurent 
matrix, then, schematically, 

T(g) H(g) 
| (an TO) 
where Æ (g) is the complex conjugate of H(g). If g(¢) is even, then H(g) 
is a real matrix and H (g) — Z (g). If, in addition, H (g) is bounded, then 


_f % Hg T(g) 0 
(an )-( ro) 
is self-adjoint since L(g) is. Hence T(g) is self-adjoint. 


Added 2/8/63. Professor Devinatz has sent me a copy of his paper 
“Toeplitz operators on H°? spaces,” to appear, dealing with the invertibility 
of bounded Toeplitz operators. This paper also employs Beurling factoriza- 
tions for functions of class Hr. In addition to other results, Devinatz 
generalizes and proves a theorem announced by H. Widom, Amer. Math. Soc. 
Notices, vol. 7 (1960), p. 63, which I have overlooked and which gives 
necessary and sufficient conditions for the invertibility of a bounded T(f). . 


Toe JOHNS HOPKINS UNIVERSITY. 


78 PHILIP HARTMAN. 


REFERENCES. 





[1] A. Beurling, “On two problems concerning linear transformations in Hilbert 
space,” Acta Mathematica, vol. 81 (1949), pp. 239-255. 

[2] P. R. Halmos, “ Shifts on Hilbert spaces,” Journal für die reine und angewandte 

Mathematik, vol. 208 (1961), pp. 102-112. 

[3] P. Hartman, “Multiplicative sequences and Töplerian (L*)-bases,” Duke Mathe- 

matical Journal, vol. 14 (1947), pp. 755-767. 

and A, Wintner, “ The spectra of Toeplitz’s matrices,” American Journal 

of Mathematios, vol. 76 (1954), pp. 867-882. 

[5] M. A. Neumark, Lineare Differentialoperatoren, Berlin, (1960). 

[6] F. Riesz, “Ueber die Randwerte einer analytischen Funktion,” Mathematische 
Zeitschrift, vol. 18 (1923), pp. 87-95. 

[7] D. E. Sarason, The theorem of F. and M. Riesz on the absolute continuity of 
analytic measures, Thesis, University of Michigan (1963). 

[8] G. Szegö, “ Beiträge zur Theorie der Toeplitzschen Formen. 1,” Mathematische 
Zeitschrift, vol. 6 (1920), pp. 167-202. 

[9] » “Ueber die Randwerte einer analytischen Funktion,” Mathematische 
Annalen, vol. 84 (1931), pp. 232-244. 

[10] S. Warschawski, “Ueber einige Konvergenzsätze aus der Theorie der Konformen 
Abbildung,” Göttinger Nachrichten (1930), pp. 344-369. 

[11] H. Widom, “Inversion of Toeplitz matrices II,” IHinois Journal of Mathematics, 
vol. 4 (1960), pp. 88-99. 

[12] A. Zygmund, Trigonomeirical Series, Warsaw-Lwow (1935). 


[4] 








ON STABILITY OF COMPACT SUBMANIFOLDS OF COMPLEX 
MANIFOLDS.* * 


By K. Koparra. 


There are two aspects of stability of compact submanifolds of complex 
manifolds. Let V be a compact complex analytic submanifold of a complex 
manifold W. We shall say that V is a strongly stable or a rigid submanifold of 
W if no small deformation of the complex structure of W changes the complex 
structure of a neighborhood of V in W. Alternatively we call V a weakly 
stable or simply a stable submanifold of W if no small deformation of the 
complex structure of W makes V disappear (see Definition 1 below). The 
rigidity of compact submanifolds of complex manifolds has been studied by 
A. Andreotti and E. Vesentini. The purpose of the present note is to 
discuss the (weak) stability of compact submanifolds of complex manifolds 
and some related topics. 


1. Stability of compact submanifolds. In what follows we assume 
that all manifolds under consideration are paracompact and connected. By 
a complex fibre manifold we shall mean a complex manifold 9 together with 
a holomorphic map p of 9 onto a complex manifold B such that the rank 
of the Jacobian of p at each point of MW is equal to the dimension of B. 
We call B the base space of the complex fibre manifold %. Moreover, for 
any point u€ B, we denote the inverse image p*(u) of u by Wa, and call it 
the fibre of W over u. Obviously each fibre Wy— p(w) is a complex 
(analytic) submanifold of 9. We denote the complex fibre manifold 9 by 
the triple (W,B,p) when we want to indicate the map p and the base space 
B explicitly. Note that, in case the fibres W,, u€ B, are compact, the triple 
(#,B,p) forms a complex analytic family of compact complex manifolds. 
For any subdomain N of B we call the complex fibre manifold (p+(N), N, p) 
the restriction of to N and denote it by the symbol W|N. Let Y be a 
complex submanifold of W |N such that p(V) =N. We call Y a fibre sub- 
manifold of the complex fibre manifold |N if and only if the triple 


* Received November 1, 1962. 
* This research was partially supported by the United States Air Force through the 
Air Force Office of Scientific Research of the Air Research and Development Command, 
under contract No. AF49(638)-253. Reproduction in whole or in part is permitted for 
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(V,N,p) forms a complex fibre manifold. If, moreover, each fibre Vy 
=U W,, UEN, of Y is compact, we call U a fibre submanifold with com- 
pact fibres of the complex fibre manifold W |N. 

Consider a compact complex submanifold V of a complex manifold W. 


Definition 1., We call V a stable submanifold of W if and only if, for any 
complex fibre manifold (W,B,p) such that p?(o) == W for a point o€ B, 
there exist a neighborhood N of o in B and a fibre submanifold Y with 
compact fibres of the complex fibre manifold 9|N such that YN W = F. 

In this section we shall prove the following theorem: 


Tunormm 1. Let © be the sheaf over V of germs of holomorphic sections 
of the normal bundle of V in W. If the first cohomology group H*(V,¥) 
vanishes, then V is a stable submanifold of. W. 


Let (%,B,p) be a complex fibre manifold such that p(0) = W for a 
point o€ B and let (u',u?,- - -,u%) denote a local coordinate on B with the 
center o. Considering V C W C W as a submanifold of 9, we cover V by 
a finite number of coordinate neighborhoods U in # and choose a local 
coordinate 
(1) f CARER AAEE AT RT), 


on each neighborhood U, such that the map p takes the form 
pi (ay: nu sun) > (ut, + +, ue) 
and such that the simultaneous equations 
. waere age) 
define the submanifold V. For brevity we write 
a= (ad, > e ut), w= (w ,wr),u— (ut un), 
and define 


| z | = max | 2° |, | | = max | w |, |u| = max | u’ |. 
a p 


We assume that each neighborhood U; is a polycylinder consisting of all points 
(4% wt), |a| <1, |u| <1, |u| <1. On the intersection Us Uz, the 
local coordinates 2°, w, are holomorphic functions of zy, wz, u: 


(2) | 2 gu (Zz, Wr, U), am1,2,,d, 
WÈ = fat (2r We, U), A=1,2,-°-,9. 

Note that 
fad (2x, 0, 0) —(. 
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We set 
Ur =V N UW. 
We denote a point on V by z and, if z= (Zk, 0,0) € U, we call zx 


= (2,1, - -, 2:4) the local coordinate of z on Ux. We define 


Gin, (z) aS [fs (2%, Wk, u) /d | Wy=U=0> 
bixdp (2) — [OF (2i, Wr, U) /BUP one, 
and write 


aux (2) = (aaa (2) Jnae 
bu: (2) = (burp (z) Jia: eun p=, ea 


The normal bundle of V in X is defined by the system of transition matrices 
aig (2) =) 
(3) ( 0 la 2 


where 1, denotes the q X q unit matrix. We denote by © the sheaf over V 
of germs of holomorphic sections of the normal bundle of V in W. Wis, by 
definition, the sheaf over V of germs of holomorphic sections of the normal 
bundle of V in W which is determined by the system of transition matrices 
(z). Hence we obtain the eract sequence 


(4) 0» ¥_3 6» 62°—> 0, 


where 6? denotes the sheaf over V of germs of holomorphic sections of the 
trivial bundle C4 X V, C4 being the space of q complex variables. We assume 
that the first cohomology group H'(V,W) vanishes. Hence we obtain from 
(4) the exact sequence 


(5) 0— H°(V, ¥) —> H°(V,) —>C1—> 0. 


Note that any element y of H°(V,®) is a collection {¥,(z)} of vector-valued 
holomorphic functions 


Ale) = (2), opr (z) y > y) 
defined respectively on U, satisfying 
pò (2) = E Gina (2) Yat (2) HE birdo (2) Yr *?, on VN Ur 
-B P 


“where y"*t, > - +, yt are constants which are independent of i. Obviously 
we have 


(6) Ky = (Yt, yt). 
In what follows we denote by a point (4,---,¢,) in the space of 
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several complex variables 1,,-- -,¢, and set |{|—max|t,|. Moreover we 
denote by M, the polycylinder consisting of all points i |t| <e, where e is a 
small positive number. We denote by T;(M.) the tangent space of M. at t. 
Consider an analytic family F of compact complex submanifolds V, tE Me 
of % such that Fa= V. $ is, by definition, a complex analytic submanifold 
of WX HM, such that FAH Xt=V;X t. We assume that F is covered 
by the neighborhoods U; X Me Clearly the image p(V;) of each compact 
submanifold V; is a single point on B.~ It follows that, on each neighborhood 
UX Me the submanifold F is defined by simultaneous holomorphic equa- 
tions of the form 


(7) N), A=1,2,° 7, 
w—H+(t), pwl,2,-°-,@. 
For any tangent vector 0/dt = >) c,d/öt, of M. at i=(, we set 
yò (z) = [86% (2, t) /at] t=0; A= 1, 2, st yt, 
y= [d6"*° (t) /öt]e=o, p=lt',g 
and let 


ya(2) = (Ya (2) Wat (2), WO: sy). 
The collection {y4(z) } of y4(z) represents an element of H°(V,®). We define 


(8) [Vt] = {1 (2)} 
and call it the infinitesimal displacement of V; along 8/dt (see [2], Defini- 
tion 4). 

THEOREM 2. There exists an analytic family F of compact complex 
submanifolds V;, GEM. «> 0, of W such that V,—=V and such that the 
map: 0/it—> [8V/dt]ı-» maps the tangent space T,(M.) tsomorphically onto 
H°(V,®) provided that the cohomology group H1(V,¥) vanishes. 

Proof. This theorem can be derived readily from Theorem 1* of [2]. 
Let n—dimH°(V,®). In view of (5) and (6) we can choose a base 
{812 Am" © *,Bn} of the linear space H°(V,®) such. that 


1 if v—=n—gqtp 
(9) Br = | 2 : 2 
0, otherwise. 
For brevity we set 
wur, for p=1,2,-- -,q, 
wW = (wt, . -wr . wi), 
faa??? (2p, We) = Wr, 
fis = (fat, + +5 fat: > +) far), 


Jir = (Ja, * +, Jut), 


STABILITY OF OOMPACT SUBMANIFOLDS. 83 
and rewrite the equalities (2) in the form 


f 2 = gar (9, Wr); 
l Wi = fix (Zr wy). 


Our purpose is to construct on each neighborhood U, X Me a vector-valued 
holomorphic function of the form 


(10) dl t) = (0; (%, ar OF (24, Dingen‘ "> tn) 
satisfying the boundary conditions 


$4 (24, 0) =0, : 
[Abs (2, £) /Aty | 10 = Bri(2); j ; v= 1,2, ',n, 
such that . 
(11) 51 (Gi (Zr pe (2, t)), E) = fir (2r Pr (2, t) ). 


We write the power series expansion of &(2,t) in t,’ ` ', tn in the form 
1 (44, t) — pij (2%, t) + hija (2 t) +: 7 "+ Sim (2, t) + s 


where each term ¢4jm(,%) represents a homogeneous polynomial of degree m 
in bt,‘ ', in and we set 


pi” (2, t) = pila (44; t) + pila (zi t) apre + Piim (2i t) . 
Then the equality (11) is reduced to the system of congruences 


(12)m bi (gun (2%, pr” (2, 8) ), E) = Far (2r pr” (2x, t) ) (mod ™**), 
m=1,2,3, +. 


Assuming that the polynomials ¢,"(z,¢) satisfying (12)m are obtained 
for an integer ease we determine homogeneous polynomials ¥4(2,¢), of 
degree m + 1 in 4,---,t, by the congruences 


Yir (2, t) = pi” (Jar (2r pr” (2, t) ), É) — fix (Ze; aa t) ) (mod im*2), 


The collection {yi (2, t) } of yu (z, t) can be considered as a homogeneous poly- 
nomial of degree m+ 1 in t4,---,t, whose coefficients are 1-cocycles with 
coefficients in the sheaf ® (see [2], 82). Thus the collection {Wa(z, t)} 
determines a homogeneous polynomial Ymii(t) of degree m +1 in ti,‘ + +, tn 
with coefficients in H'(V,®). The homogeneous polynomial ym+ı(t) is called 
the m-th obstruction. 

In order to construct the holomorphic functions 4;(%,¢) satisfying (11) 
it suffices to show that the obstruction Wm(t) vanishes for each integer 
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m=1 (see [2], Theorem 1*). To show the vanishing of ym (t) we impose 
on 5*(z,t) an additional restriction that 


(13) on - Br (24, t) = C bg in © as ba). 
Then, since fixt? (Zr, Wk) = wı"*?, we obtain 
y? (2, t) =0, for p==1,2,' > *,q. 


Thus the coefficients of the homogeneous polynomial {yax (z, t)} are 1-cocycles 
with coefficients in the subsheaf % of %. By hypothesis the cohomology group 
H*(V,%) vanishes. Hence the obstruction ym.i(¢) vanishes. Moreover the 
1-cocycle {Yir(2,t)} is a coboundary of a 0-cochain {x,(z,¢)} composed of 
homogeneous polynomials %(z,¢) of degree m-H1 in t,’ - -,t, whose coeffi- 
cients are sections of the sheaf Y over U,. Thus 


X (z, t) = (xi (2,4), © +X (2, #)) 


and 
ya? (2, t) = È a (2) Xë (2, t) — xò (z, t), for À = 1, EET 7 
E . 
We define 
a] mas (2i, t) = (xë (2, 4), ° * +, Xs" (2, t), 0,0, > *,0) 
and set 


pit (2, t) = Br (24, t) -f- Pilm (2i, t) ® 


The polynomials ¢;™*! (z, t) thus obtained satisfy the congruence (12) ms: and 
the condition (18)m.:.. We remark that, by (9), the linear terms 


(tt) =È Bu(2)t 


satisfy the condition (13),. This completes our inductive proof of the 
vanishing of ymn (t), q.0.d. 

Remark. In view of (10) the family § is defined on each neighborhood 
UW, X M. by the simultaneous equations 


(14) We A= 1, 2,°: RT 
UP = tn gap, p= 1,2, > +49. 

Proof of Theorem 1. Let N. denote the neighborhood of o in B con- 

sisting of all points u = (ut, - -,ut), |u| <e, where e is a small positive 

number. Considering the family $ of compact complex submanifolds V, 

tE Me, of W defined by (14), we define a linear map: u—>t(u) of N. into 

M. by setting 

(15) t(u) = (0,0,- - *,0,u7,u?,- > +, ue), 
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Then the union V = U Frw) of the submanifolds Fig WEN. of W forms 


u 
a fibre submanifold with compact fibres of the complex fibre manifold W |N. 
and VN W= Fy. Thus we conclude that V is a stable submanifold of W, 
qe d. 

Let (W,B,p) be a complex fibre manifold and let W=p"(o) be the 
fibre of W over a point o€ B. Moreover, let V be a compact complex sub- 
manifold of W and denote by & the sheaf of germs of holomorphic sections 
of the normal bundle of V in W. The above Theorem 1 asserts that, if 
H? (V, X) vanishes, then, for a sufficiently small neighborhood N of o in B, 
there exists a fibre submanifold % with compact fibres of the complex fibre 
manifold W|N such that YNW=V. The fibre submanifold Y is, in 
general, not unique. In fact, in the above construction of Y = U Vin, we 


may replace (15) by 
(15)’ t(u) = (Fu), 7 selu): -ot (u), w, *, U2) 


where the #X(w) are holomorphic functions in u such that #4(0) = 0, | A (u)] 
<e for | u | <e 


THEOREM 3. If the cohomology groups H'(V,¥) and H° (V, Y) both 
vanish, then, for a sufficiently small neighborhood N of o in B, there exists 
one and only one fibre submanifold Y with compact fibres of the complex 
fibre manifold W|N such that VNA W == V. 


Proof. It suffices to prove the uniqueness of Y. In terms of the local 
coordinate (1) the submanifold Y is defined on each neighborhood U, by 
simultaneous equations of the form 


we =ò (a, u), A= 1,2 r 


Writing ¢ for u we consider Y as an analytic family consisting of compact 
submanifolds Vi=UN p(t), tEN of %. Obviously the submanifold F; 
is defined on each neighborhood U, by the simultaneous equations 


| wò = 04 (z; t), A=], 2; +57, 
UP = É, p= 1,2, A 


We compute the infinitesimal displacement [0V;/0#];.. and find that 

(16) x[8V:/8E] to = (Cu Cs * 5 Cg), for 3/8t = > cp3/ te. 

Since, by hypothesis, H°(V, W) vanishes, we infer from (5) that the map 
x: H°(V,8) > Ce 
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is bijective. Combining this with (16) we see that the map: 0/dt—> [9/08] -o 
maps the tangent space T(N) of N isomorphically onto H°(V,®). Conse- 
quently the analytic family V of the compact submanifolds V;, tE N, of W 
is maximal at t==0 (see [2], Theorem 2). Now let % be another bre 
submanifold with compact fibres of W|N such that WOW—V and let 
Vi= UW N p(t) for tE N. Since the family Y is maximal at t= 0, there 
exists a holomorphic map h: t—h(t) of N into N such that Vy = Vac). 
It follows that t= p(Vi) = p(Vawy) = h(t) and therefore Vë =V, Thus 
we see that % coincides with Y, q.e. d. 


Exımpıe. Non-singular rational curves on complex analytic surfaces. 
Let C be a non-singular rational curve on a complex analytic surface S and 
let s(C,C') denote the intersection multiplicity of C with itself. Letting Y 
be the sheaf over C of germs of holomorphic sections of the normal bundle 
of C in S, we infer readily that H1(C,%) vanishes if and only if (0, C) = — 1. 
Hence we conclude that, tf t(C, C) =— 1, C is a stable submanifold of 8. 

A simple example of surface containing a non-singular rational curve C 
with +(C,C) =0 is given by a rational ruled surface. Let P be a projective 
line and denote by ¢ a non-homogeneous coordinate on P. Moreover let U, 
and U, be two copies of the space C of a complex variable z. For each integer 
n= 0 we form a rational ruled surface . 


Sa=PXU,UPX Us, 
by identifying (1,21) € PX Uz with (f:,%) €P XU, if and only if 
Joe 


Z, mm 1/23, 
and we denote by C the curve on S, defined by the equations ĉ, = ĉ: =Q. 
Clearly C is a non-singular rational curve with s(C,C) =—n. Moreover, 
for any irreducible curve T on Sa, we have the inequality: i(T, T) 2=—n. 
Now we show that, in case n= 2, C is an unstable submanifold of Sn 
For each complex number t we define a surface 


Int P X ULU PX up 
by identifying (f1,2) € PX Ui with (2,22) € PX Ü, if and only if 


Ea = Zaba + tze*, 
ay) pe 1/23, 


where k is a txea positive integer $n. The surface S,; depends holo- 
morphically on ¢. Thus the set of all surfaces Sn: form an analytic family. 
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It is obvious that Sao coincides with Sæ, while, for 1340, Sat is complex 
analytically homeomorphic to the ruled surface Spex. In fact, introducing 
new variables i 
= (rt — t) /ti, 
bo! = C2/( tas" *f, + t), 


we infer readily that the equalities (17) are equivalent to 


od FT ake, 
A Z == 1/22- 

It follows that there exists on Sat t340, no irreducible curve. C; with 

4(C,,C;) =—n. Thus we see that the curve C on S, is unstable. . 


2. Stability of fibre structures. Let W be a complex manifold. By 
a fibre structure on W we shall mean a pair (B, p) of a complex manifold B 
and a holomorphic map p of W onto B such that the triple (W, B, p) forms 
a complex fibre manifold. A (complex) analytic family of compact complex 
manifolds is, by definition, ‘a complex fibre manifold with compact fibres. 
Let H — (%,S,®©) be an analytic family of compact complex manifolds. 
By an analytic family of fibre structures on the analytic family W we shall 
mean a pair (8,P) of an analytic family B = (8, d,r) of compact complex 
manifolds and a holomorphic map P of W onto B such that rP =o and 
such that the triple (W,8,P) forms a complex fibre manifold. For each 
point s of $ we set W, = w (s), Bym=a4(s) and denote by p, the restriction 
of the map P to the submanifold W, of 9. Obviously the pair (B. ps) 
defines a fibre structure on W, We call (Ba, ps) the fibre over s of the 
family (8, P). 


Definition 2. A fibre structure (B,p) on a compact complex manifold 
W is said to be stable if and only if, for any analytic family # — (%, S, w } 
of compact complex manifolds such that »!(o)=W for a point o€ 8, 
there exist a neighborhood N of o in S and an analytic family (8, P) of fibre 
structures on the analytic family |W of which the fibre (Bo, po) over o 
coincides with (B, p). 

A compact complex manifold V is said to be regular if and only if the 
first cohomology group H!(V,6) of V with coefficients in the sheaf 6 over 
V of germs of holomorphic functions vanishes. 


THEOREM 4. Let (W,B p) be a compact complex fibre manifold. If 
all fibres p*(b), bEB, are regular, then the fibre structure (B,p) on W 
1s stable. 
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Proof. Let (%, S, w) be an analytic family of compact complex manifolds 
such that w-(o) == W for a point o€ 8 and let (u*,w?,-- -,u%) denote a 
local coordinate on S with the center o. We take a point b€ B and let 
V=p(b). We cover V by a finite number of coordinate neighborhoods 
U, in W and choose a local coordinate 


(ai, 2 +, 24%, wi, ul: ` ut) 
on each neighborhood U; such that the map w takes the form 
wi (at: eu -,u2) > (ul, un) 
and such that the simultaneous equations 
1 


Wi = ee OY tae + ee ee À) 


define the submanifold V. Since V is a fibre of the fibre manifold W, we 
may assume further that 


wò = Wò, : on WN U N Up. 


For brevity we write 2 == (2, ++, 27), Ww = (wi, ++, we") and u == (ut, ++, we), 
The normal bundle of V in % is defined by a system of transition matrices 


of the form 
a 
0 ty 


(compare (3)). Let ® be the sheaf over V of germs of holomorphic sections 
of the normal bundle of V in } and let Ø” denote the sheaf over V of germs 
of holomorphic sections of the trivial bundle C” X V. Then we have the 
exact sequence 


(18) 0—> 6 —> fo. 


Since, by hypothesis, the fibre V is regular, the cohomology group 


H'(V,6”) vanishes for v==1,2,3,; >+. Hence we infer from (18). that 
the sequence 
(19) 0 — C'—> H° (F, &) —> C15 0 


is exact and that H*(V,&) vanishes. By virtue of a theorem of completeness 
of characteristic systems (see [2] $1), we conclude therefore the existence 
of an analytic family F of compact complex submanifolds V;, tE Me, of W 
such that V, == V and such that the map: 8/98 [9 ,/öt]ı-. maps the tangent 
space T,(M,.) isomorphically onto H°(V,®), where M, is the polycylinder 


STABILITY OF COMPACT SUBMANIFOLDS. 89 


5 center 0 and of radius e>0 in the space of r-+g complex variables 
"zb bey ts brags 

Now we examine the Kisleinre of F. On each neighborhood U; the 

submanifold V; is defined by simultaneous holomorphic equations of the form 


wò = G(x, t); A=1,2,- "yt; 
20 
5 | UP =m "+P (t), p= 1,2, ¢,, 
an 
[8V /dt 1 = (ye (z), ` nye (z) y A sy), 
where 


Ye) = [89 2 t) Bl], yt [09 (t) /At] x0. 
In view of the exact sequence (19), we may assume therefore that 


[30A (% t) /öt, | 10 = 5), for v==1,2,:°-,7, 
[80+ (t) /8tr lizo = 8", for vl,‘ ER nee ,r+ q. 


These equalities show that the simultaneous equations (20) are solvable with 
respect to the variables t, ta’ ` ', trng; namely (20) are equivalent to the 
simultaneous holomorphic equations of the form 


(21) ty = Ty (2i Wi, U), v==1,2,°--,r+q. 
Thus we conclude that the union U = y V; of the submanifolds Vi, tE Me 


forms a neighborhood of V in W and that there ts a holomorphic map r of 
U onto M, which maps V; onto t, provided that the positive number e is 
sufficiently small. 

We construct for each point bE B a neighborhood U(b) of p>(b), a 
polycylinder M(b) and a holomorphic map 7, of U(b) onto M(b) in the 
manner described above. Moreover we take in each polycylinder M(b) a 
sufficiently small concentric polycylinder C(b) and let V(b) =7,7C(b)- 
Obviously V(b) is a neighborhood of p*(b). Now we select a finite number 
of neighborhoods Y(d,), j=1,2,- - -,1, which cover W in such a way that, 
if V(b;) NV(bz) is non-empty, then V(b) C U(bz) and V (bx) C Ulb,). 
For brevity we write V; = U(b;), C;==-0(b;) and denote by 7; the restriction 
of Ta to UV; Moreover we set 


Or = y (V N Ve), 


provided that V; N Vy is non-empty. Consider a point tin Cy C O; Since 
V; C U(be),, r7 (t) is a compact complex submanifold of U(bs), while +5, 
is a holomorphic map of U(b;) onto M (b+). Hence rary (t) is a single point 


90 - XK. KODAIRA. 


on Jf (b+) which is obviously contained in the subdomain Cy of M (bx). Thus 
we infer that rxrj is a biholomorphic map of Cp, C C; onto Ory C Cy. Conse- 
sequently, identifying Cæ C C; with Ch; C Op by means of the map rrj”, 
we obtain from the collection of the polycylinders C; a complex manifold 
C= y C;. We form the union Y = UV; of UY; Obviously % is an open 


subset of % which contains W. We define a holomorphic map P of Y onto 
C by setting P = r7; on each Y; Let 


r= w P. 


It is clear by (20) and (21) that + is a holomorphic map of C into 8. 
Let N be a neighborhood of o in 8 such that w(N)C WV and let 
—r!(N)=Pw-(N). We infer readily that the triple (8, N, r) forms 
an analytic family of compact complex manifolds and that the pair (8, ?) 
defines an analytic family of fibre structures on the analytic family 
H |N = (w>(N), N, w). It is clear that the fibre (Bo, po) of (8, P) over 
o coincides with the fibre structure (B,p), q.e.d. 


Remark. For any compact complex manifold V which is irregular in 
the sense that H+(V, O) +0, O being the sheaf over V of germs of holo- 
morphic functions, there exists a compact complex manifold W with an 
unstable fibre structure (B, p) such that the fibres p-*(b), be B, are complex 
analytically homeomorphic to V. In fact, an example of such a manifold is 
given by the product W == P X V of V and a projective line P with the fibre 
structure defined by the canonical projection p of W onto P. In order to 
show that the fibre structure (P, p) of W is unstable, we construct an analytic 
family of projective line bundles over V in the following manner: Let {U4} 
be a finite covering of V by polycylinders U, and let {hy} be a 1-cocycle 
composed of holomorphic functions hy = Agy(z) on UN Ur which represents 
an element h>40 of H!(V,6). For each complex number ¢ we define a 
compact complex manifold 
Wi == y PX U: 
by identifying (&,2)EPX U: with (:,2) € P X U; if and only if 

i= Cx exp tha (2). 


It is clear that (&,2) —z defines a holomorphic map of W; onto V and thus 
W; is a projective line bundle over V. Obviously the set of all projective line 
bundles W,, t€ C, forms an analytic family and W, coincides with W. The 
projective line bundle W; is trivial if and only if ¢ belongs to a discontinuous 
subgroup A of the additive group C. Thus, for ¢¢ A, W; has no holomorphic 
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section: z— (&(2),2) with {(z) 540, zw. This shows that each fibre 
p(t) =X V, £0, oo, of the complex fibre manifold (W,P,p) is 
unstable. It follows immediately that the fibre structure (P,p) of W is 
unstable. 


8. Exceptional submanifolds. In what follows we denote by P, a 
complex projective n-space, n=21. By aP,-bundle we mean a complex analytic 
fibre bundle of which the fibre is P, and the structure group is a projective 
transformation group acting on P,. We note that any complex fibre manifold 
whose fibres are complex analytically homeomorphic to P, is a P,-bundle 
(see [3], p. 448). We denote by #(P,) the fundamental complex line bundle 
on P,, i.e., the complex line bundle determined by a hyperplane in Pa. Let 
V be a compact complex submanifold of codimension 1 of a complex manifold 
W and let F denote the normal bundle of V in W. Note that F is a complex 
line bundle over V. 


Definition 3. We call V an exceptional submanifold of W if and only 
if V satisfies the following conditions: i) V is the bundle space of a P,-bundle ; 
thus there exists a holomorphic map p of V onto a compact complex manifold 
B such that, for each point b€ B, p*(b) is (complex analytically homeo- 
morphic to) Pa; ii) the restriction F | p+(b) of F to each fibre p*(b) of V 
is equal to the inverse of the fundamental complex line bundle #(P,) on the 
fibre p> (b) = Py. 


THEOREM 5. Every exceptional submanifold of a complex manifold is 
stable. Let (W,S,w) be a complex fibre manifold and let V be an excep- 
tional submanifold of a fibre W = w> (0), o€ S, of W. Then, for a sufficiently 
small neighborhood N of o in 8, there exists one and only one fibre sub- 
manifold V of the complex fibre manifold W|N such that YOW=V. 
Moreover each fibre Ve=YNw+(s), seN, of V is an exceptional sub- 
manifold of w-*(s). 


Proof. Let F be the normal bundle of V in W and let % be the sheaf 
over V of, germs of holomorphic sections of F. By hypothesis, there is a 
holomorphic map p of V onto a compact complex manifold B such that 
p*(b)—P, and F | p*(b) =—E(P,) for each point bE B. It follows 
that the cohomology group H2(V,%) vanishes for g==0,1,2,---. Hence, 
by Theorem 1, V is a stable submanifold of W. Moreover, by Theorem 3, 
there exists one and only one fibre submanifold 9 of W|N such that 
VN W =F. 
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Now, by Theorem 4, the fibre structure (B,p) on V is stable. Thus 
there exists an analytic family (8,P) of fibre structures on the analytic. 
family Y of which the fibre (By, po) over o coincides with (B,p). Consider 
the fibre (Ba p.) of (8,P) over seN. Every fibre po*(b), bEB,, of 
¥V=WUNo- (0) is complex analytically homeomorphic to Pa, while the 
complex structure of P, is rigid (see Frölicher and Nijenhuis [1]). Hence we 
conclude that every fibre p,-1(b), b € B,, of each fibre manifold V, = UN w-1(s), 
se N, is complex analytically homeomorphic to Pa. Thus the fibre manifold 
V, is a P,-bundle. It follows immediately that V, is an exceptional sub- 
manifold of w-1(s), q.e.d. 


4. Monoidal transforms, Let Z be a compact complex manifold. For 
any compact complex submanifold C of Z of codimension n= 2 we denote 
by po the monoidal transformation with the center C. The monoidal trans- _ 
form uo(Z) of Z is a compact complex manifold and the total transform 
po(C) of C is an execption submanifold of uo(Z). Moreover the inverse po 
of po is a holomorphic map of po(Z) onto Z which maps po(Z) —po(C) 
biholomorphically onto Z—C. 


Consider an analytic family @ of compact complex submanifolds Cs 
seN, of Z, where N denotes a connected complex manifold. 6 is, by 
definition, a fibre. submanifold of the complex fibre manifold (Z X N,N,r), 
where aw denotes the canonical projection of Z X N onto N, and 


C.X8s=BNZ Xs, for sE N. 


Let (Z X N) denote the monoidal transform of Z X N with respect to the 
center 6. The fibre structure (N,7) on ZX N induces a fibre structure 
(N, 1) on (ZX N) such that 


Um (s) = po, (Z), for sE N. 


Thus the triple (u(Z XN), N, O) forms an analytic family consisting of 
the monoidal transforms po, (Z), se N, of Z. 


Definition 4. The monoidal transform po(Z) of Z will be said to be 
stable if and only if, for any analytic family (0,8, w) of compact complex 
manifolds such that w~ (0) ==yo(Z) for a point o € S, there exist a neighbor- 
hood N of o in § and an analytic family 6 of compact complex submanifolds 
Ca sE N, of Z such that C, = O and such that the restriction (W |N, N, w) 
of (W, S, w) coincides with the analytic family (a(Z X N), N, I1) of the 
monoidal transforms po, (Z), 8€ N, of Z. 
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Trrorem 6. Let ® denote the sheaf over Z of germs of holomorphic 
vector fields. If the first cohomology group H!(Z,®) vanishes then any 
monoidal transform yo(Z) of Z is stable. 


Proof. We set W = po(Z), f—pot and let G denote the graph of the 
holomorphic map f of W onto Z. The graph @ is, by definition, the sub- 
manifold of W X Z consisting of all points (w,f(w)), we W. First we shall 
show that G is a stable submanifold of W X Z. Let p denote the restriction 
to G of the canonical projection W X ZZ. Obviously 


hk: w— (w,f(w)) 
is a biholomorphic map of W onto @ and 
(22) ph=f. 


We fix a finite covering U = {U;} of Z by coordinate neighborhoods U, with 
respective local coordinates 4= (zt, © +,2",° °°, ) such that each non- 
empty intersection C N U, coincides with the coordinate plane: zp == g? =m- - 
== 4” = 0), Moreover we assume that each U, is the polycylinder :|%| <1. 
The equality (22) shows that p is a monoidal transformation with the 
center C. Hence we conclude by an elementary consideration that 


(23) H (p> (Ui), 6) = 0,. 
where @ denotes the sheaf over p1(U,) of germs of holomorphic functions. 


Let © denote the sheaf of germs of holomorphic sections of the normal 
bundle of Gin W X Z. The normal bundle of G in W X Z is induced from 
the tangent bundle of Z by the map p of G onto Z, while the tangent bundle 
of Z is trivial on each neighborhood U, Hence, by (23), the cohomology 
group H*(p*(U,),¥) vanishes. Letting 11* denote the covering {p*(U;)} 
of G, we infer therefore that 


H(G, Y) = H (U*, v) =H (1, 8) = H(Z, 6), 


while, by hypothesis, H*(Z,®) vanishes. Hence the cohomology group 
H"(G,%) vanishes and consequently, by Theorem 1, G is a stable sub- 
manifold of W X Z. 

Let (H, S, w) be a complex analytic family of compact complex mani- 
folds W,—ow-1(s), s€ S, such that W, = W = po(Z) for a point o€ 8. 
The total transform uo(C) is an exceptional submanifold of W,. Hence, 
by Theorem 5, there exist a neighborhood N of'o in S and a fibre submanifold 
V of the complex fibre manifold W |N such that YN W, = po(C) and such 
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that each fibre V,=YUOW,, SEN, is an exceptional submanifold of W, 
Thus V, is (the bundle space of) a P,.-bundle over a compact complex 
manifold C, Moreover the manifolds C., s€ N, form a complex analytic 
family (@,N,7) and there exists a holomorphic map P of Y onto @ which 
reduces on each fibre V, of Y to the canonical projection of V, onto O, 
Thus % is (the bundle space of) a P,.-bundle over 6. In what follows 
we always assume that N is sufficiently small and write for the sake of sim- 
plicity W in place of W|N. 

We consider W X Z as a complex analytic family consisting of the joli 
manifolds W, X Z, seN. Since @ is a stable submanifold of W, X Z, there 
exists a fibre submanifold & of the complex manifold 9% X Z such that 
ENWXZ=G. The submanifold %4 defines a holomorphic map F oft W 
onto Z of which the graph is &. Clearly F is an extension of the map f of 
W, onto Z which reduces on V, to the canonical projection of the P,.,-bundle 
¥ onto its base space C,=~C C Z. Hence we infer that F maps each fibre 
of the P,.-bundle Y onto a point in Z and that FP- is a holomorphic map 
of @ into Z which is biholomorphic on each fibre C,, 3€ N, of 6. We identify 
O, with the submanifold FP~(C,)<s of ZXN and consider @ as an 
analytic family of compact submanifolds of Z. Moreover we define I to be 
the holomorphic map 

w->II(w) — (F(w), w (w)) 


of W onto ZX N which maps each fibre W, of W onto Zs. Clearly II is 
an extension of the map f= po% of W, onto ZXo=Z while, on the sub- 
manifold Y of W, the map H coincides with the map P of Y onto £. 
Hence we conclude that II"! is a monoidal transformation with the center £. 
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ON A QUESTION OF BISHOP AND PHELPS.* 


By Vicror Kirg? 


In a remarkable paper, Bishop and Phelps [1] settle several important 
questions concerning supporting hyperplanes of convex sets in Banach spaces. 
In particular, they show that if C is a closed convex subset of a Banach space 
E and Ø ACE, then C has many support points. (These are points p 
of C which lie on supporting hyperplanes of C, or equivalently for which 
fp == inf fC for some f € H*~ {0}.) Completeness of E is essential, for the 
author [3] has described a precompact closed convex set A in an incomplete 
inner product space such that A has no support points. (See also p. 158 of 
Bourbaki [2].) As is mentioned in [1] and detailed in [5], some of the 
machinery of [1] can be developed in an arbitrary complete locally convex 
space. However, this does not extend to the theorem quoted above, and both 
[1] and [5] ask whether a closed convex subset of a complete locally convex 
space must have support points. In the present paper, this question is 
answered negatively by means of an example in the cartesian space R% (with 
its usual product topology). However, some interesting unsolved problems 
remain and these are mentioned at the end of the paper. 

The points of the space R% are infinite sequences z— (v, Tat - -) of 
real numbers. For each ne N (natural numbers), let L, denote the n-dimen- 
sional linear subspace of R* consisting of all points ze R* such that t4 == 0 
for all+>n. Let m, denote the natural projection of R*®» onto La, so that 
an(&) = (Z° + +, 2a 0,0, <°) €L,. We shall construct a closed convex 
proper subset C of R* such that C contains the positive cone P = {æ € R%: 
a, =: 0 for all +}, and such that for each ne N the set m. is an open subset 
of La. If a linear functional f on R% is bounded below on C it is evident 
that inf fP == 0, whence f== gr, for some ne N and ge L,*. (For a proof 
of this, see Mackey [4].) Except when g is identically zero, the openness of 
aC in Lẹ implies the openness of gr,C in R and thus f cannot attain a mini- 
mum on Ọ. Since this is true even without assuming the continuity of the 
linear functional f, it follows in a very strong sense that C has no support 
points. 


* Received November 6, 1962. 
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To start the construction of C, we choose a convergent series Sia, of 
positive numbers and a continuous concave function 8 which takes [0,0o[ onto 
[0,1[ and is (necessarily) strictly isotone. And we choose also, for some 
me N, a closed convex set Ca for which PO Lm C Om C Im. (For example, 
we may choose a, == 2-*, 8(7) ==7/(1-+7), and Cı =P N L.) Having defined 
Om ,0ı (tm), we define 


(0) Ona = {2 € Lir: Cy 20 and m(z) E€ O + a(t) U4}, 
where U, is the (Euclidean) open unit ball of L, (Thus 


4 
U= {ce Ly: E (2)? SI}, 
Ja 


and the condition on m(x) requires the point (2,,- - -,2%,0,0,---) to lie 
in the open a8;(2441)-neighborhood of the set C;.) The set C is then defined 


as the closure in R% of the union U C;. 
jem 


We make the following claims: 
(1) Om C Oma C Om li 
(2) each set C; is conves (12 m). 


In fact, (1) is evident and (2) follows from an easy inductive argument 
which employs the convexity of the sets Ci, and U,. and the concavity of the 
function ô. 


j-1 
Now define qu = 0, y— da, for 1Si<jandy=limny. We claim: 
ti É j>% 


(8) ml 0; + yU: (j =1i= m); 


(4) (GN (a: te <r}) C O+ (ny — (1—8(T + my) ona) U: 
jzizmk2i+10<r<o). 


To prove (3), note first that since 8[0,0[=[0,1[ and U, = [0, 1[U;, 
it follows from (0) that 7,C,4.—C,+4,U, and m0, == 0, + trU, = C0, for 
all r=m. Now suppose it is known, for a certain i and j, that mC, 
= C+ U; Then we have 


mO ja = meri pa = m (0H ays) = 0; + apr; 
= 0; ys + U= Ce + (hy + o) Ui = Cy + mga Oe 


Thus (3) follows by mathematical induction. 
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For (4) it suffices (in view of (1)) to consider the case in which j > k. 
We have 


mlO; N {z Tk < r}) = rO} N {a: Ti L th) 
Cc ml; N {z € Ly: tr L r}) (Ci + aU x) N {z € Ly: Tr L r}) 


C merah (Cr N {2 € Lr: Te <r + mah) + mex) 
Ç (Cra + Slr + ej) araU w) + meU na 


mm mlr + (Kr + twa + nU ka 
= Os + ma- Us + (a-oa — (1 — Ir + ey) 0) Ui 


= Oy + (my — (1 — 8(r + m) ) Ger) Ui 


where several of the steps are routine, — and — are based on (3), C re- 
4 


quires an easy verification, and . depend on (0). ° 


Now let C = cl Ü, C;. By (1) and (2), C is convex. From (0) and the 


choice of Om it is ey that Cp; D PO L; for all i= m, and hence CD P. 
By (3) it is true that for each = m, 


mC D U (Cy + ys) = Ci + Ue 
where of course C4 -+- mU; is an open proper subset of Z, Thus to complete 
the proof, it suffices to show that U C O+ mU But this is a consequence 
of (4), for (4) implies that if 21,2°,- - -, is a sequence of points in C such 
that the sequence m1(2*),m;(2?), > - converges to a point of the boundary 
of Ci + mU, in La then lim T" =o for all k = i+ 1, where at (m4h, ta, - +). 
> 


Thus the set C has no support points even though it is a closed convex 
proper subset of the complete metrizable locally convex space R. 

The question and theorems of Bishop and Phelps [1,5] referred to 
supporting hyperplanes corresponding to linear functionals f which are con- 
tinuous over the entire space. However, the question is also of interest under 
weaker continuity requirements and in the absence of continuity. Note that 
no nontrivial linear functional (continuous or not) attains a maximum or 
minimum on the set O constructed above. However, the following questions 
are apparently open. 


(Q1) If K is a bounded closed convex subset of a complete locally 
convex space E, must K have a support point? If not by means of a linear 
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functional f € E*, what about an f for which the restriction fx is continuous 
or even one which is merely algebrascally linear with no continuity restriction ? 


(Q2) If K is a closed conver subset of a normed linear space, must K 
have a support point by means of a linear functional f for which fr is con- 
tinuous or at least by means of some linear functional? If not in the general 
case, what happen when K is bounded? 


These questions are not answered by the example above (the set C) or 
by the example in [3] (the set A mentioned earlier), since every bounded 
subset of R% is relatively compact and the set A is supported by hyperplanes 
corersponding to linear functionals f for which f4 is continuous. 
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THE DIMENSION OF SPACES OF AUTOMORPHIC FORMS.*! 


By R. P. LANGLANDS. 


1. The trace formula of Selberg reduces the problem of calculating the 
dimension of a space of automorphic forms, at least when there is a compact 
fundamental domain, to the evaluation of certain integrals. Some of these 
integrals have been evaluated by Selberg. An apparently different class of 
definite integrals has occurred in Harish-Chandra’s investigations of the 
representations of semi-simple groups. These integrals have been evaluated. 
In this paper, after clarifying the relation between the two types of integrals, 
we go on to complete the evaluation of the integrals appearing in the trace 
formula. Before the formula for the dimension that results is described let 
us review Harish-Chandra’s construction of bounded symmetric domains and 
introduce the automorphic forms to be considered. 

If G is the connected component of the identity in the group of pseudo- 
conformal mappings of a bounded symmetric domain then G has a trivial 
centre and a maximal compact subgroup of any simple component has non- 
discrete centre. Conversely if G is a connected semi-simple group with these 
two properties then G is the connected component of the identity in the group 
of pseudo-conformal mappings of a bounded symmetric domain [2(d)]. Let 
g be the Lie algebra of G and ge its complexification. Let G, be the simply- 
connected complex Lie group with Lie algebra g,; replace @ by the connected 
subgroup @ of G, with Lie algebra g. Let K be a maximal compact sub- 
group of G with Lie algebra f; then f contains a Cartan subalgebra ý of g. 
Fix once and for all an order on h. This order is to be so chosen that g, is 
the direct sum of fe, p+, and p_; p, is spanned by the root vectors belonging 
to the totally positive roots and p_ by the root vectors belonging to the totally 
negative roots. Moreover p, and p_ are abelian and [f,,p,] Cp, and [čto p_] 
Cp. Let P,, P_, and K, be the connected subgroups of G, with Lie algebras 
Pa P- and f, respectively. The exponential mapping of p, into P, is bijective; 
thus P, is provided with the structure of a complex vector space. Moreover 
GCP,K,.P_ and P, N K-P_= {1}. Then P,K,P_/K,P_ which is identified 
with p, is a complex vector space and the image of @ is a bounded symmetric 


* Received November 26, 1962. 
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domain B. Finally it should be observed that G N K.P- =K and that p, is 
an open subset of the space G,/K,P_. Now identify p, with complex coordi- 
nate space and let z be the column of coordinates. If ge G,, z€ p,, and 
z — g (z) € p, (in the space G,/K,P_) let dz —p(g,z)dz. Before defining 
the automorphic forms it is necessary to establish a lemma. 


Lemma i. Let È, be the restriction of K, to p, then u(9,2) € Ko. 


Suppose X € p, and f(-) is holomorphic in a neighborhood of 2 on p, 
or P, since they are identified. Set h(p,kp_) —f(p.), EP, kE Ko, p_€ P 
then h(-) is a holomorphic function on part of Ge Let z=p€ P, and 
z = p € P, then, at t=0, 


Š h(g exp (tX)p) = he (to(X)) 9) 


—Sh(p exp (tp49(X))) 
UK )hp) +L (Za) h(p") +L (Za)h CP) 
= 1(X,)h(p") — R(X) hy). 


Here p’19(X) =X, +X: + Xs, X1€ pr, X2E fo Xs € p- L(X,) and R(X) 
denote the obvious left or right invariant differential operators. It is necessary 
to verify that the map X > X, is given by an element of Ke. But gp = p'kp. 
so pigekp p+ and kppt(X) =kp_(X) =k(X)(modf,+p-); thus 
Xı=k(X). Finally it should be remarked that »(g,z) is a holomorphic 
function of g and 2. 

Suppose that o is an irreducible, holomorphic matrix representation of K, 
of degree d which is unitary on X. Then, since (9192, 2) = u (gas 922) u (Ga) 2), 
it is easily seen that the action of G on the space H(c) of holomorphic 
functions on B, whose values are column vectors of length d, defined by 
gf (2) = 0*(g,2)f(g2), with o(g,2) —o(u(g,4)), is a representation of G. 
If T is a discrete subgroup of @ define an (unrestricted) automorphic form 
of type o to be a function fin H(o) such that yf =f for all yin T. For sub- 
groups of the symplectic group this definition is essentially the same as that 
of [7]. As is shown there the dimension of the space, H (T, o), of automorphic 
forms of type o is finite if G/T is compact. For a large class of represen- 
tations o the calculations of this paper lead to the following formula for the 
dimension 
(1) N(T,c) ar: 


The sum is over a set of representatives of those conjugacy classes of T that 
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have a fixed point in B. Gy is the centralizer of y in G and Ty is the cen- 
tralizer of y in T. If the Haar measure v on @, is appropriately normalized 
then x(y) equals 


(—1)™/o(By) {[@y? 0x] I (Ho) II (A — eis) j= 
(2) ” a g Py 
x >e (8) H (sA (Ha) + sp (He) ) eeAH)+sp(H), 


The various symbols will be explained in the course of the proof. This formula 
agrees with those presented in [3] and [6]. 


2. In this paragraph and the next the trace formula is reviewed in our 
special context and a first connection with the work of Harish-Chandra is 
established. The end result is formula (1) with the numbers x(y) expressed 
as integrals. 

Since »(k,z) =k if ke K, the measure 


dem | det(u(g,0)) |+ II ddyo 


with z= g(0), is well defined on B and invariant under G. The invariant 
measure on ( is to be so normalized that 


J i@de— f H9(0) ag. 


Set G(z) =o*1(g,0)o7(g,0) with z=g(0). G(z) is well defined and 
G(g(z)) —o* (9,2) G(z)o7(g,z). Introduce the space H?(o) of functions 
fin H(c) for which (f*(z)@(z)f(#)de is finite. The action of Œ on H?(c) 
is easily seen to be unitary. The functional f— f;(z), where f;(z) is the j-th 
coordinate of f(z), is bounded on H?(e) ; let 


f, 99° Gxs42)G (aa) (20) dea = f(t) 
and set K (21,22) = (91 (21, 22),° * ",9a(21,22))*. Observe that K (gz, 922) 
= o (g, 21) K (21, 22)0*(g, 22). If L?(c) is the space of measurable functions f 
on B for which ff*(2) @(z)f(z)de is finite then 
gs) — f, Kan) G (22) f (22) ds 
B 
defines the orthogonal projection of L?(c) onto H?(o). Consequently 


K* (22,21) = K (21, 22) and Í, E (25, 22)Q (22) K (29, 21) daa = K (2,2). 
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Although not necessary it is convenient to verify now that the represen- 
tation of G in H? (e) is equivalent to a representation investigated by Harish- 
Chandra [2(c)]. Let W be the inverse image of B under the map G,— G,* 
—> G;*/KP. (W = P_K,B> if B is considered a subset of P,); then if 
gEW and fEH(o) set f(g) =o*(g*,0)f(g>(0)). Then f(g) satisfies: 
(a) f (pkg) =o(k)f(g) if pe P- and ke K,; moreover f(g) is holomorphic 
on W and if f(z) is in H?’ (e) then 


OP S POO S IHN“. 
So the mapping is an isometry on H? (o). The kernel is replaced by 
K (91, 92) == o* (g1, 0) E (gx * (0), ga™ (0) Jo? (ga, 0). 


Observe that (i) K (kigu, keg2) =o (k1) K (91, g2)o* (k2) if k,k,e RK, (ii) 
E (p93, 92) = K (gu, pge) =K (gr, 9a) if pe P_, (ili) K (919, gag) = K (gu 92) 
if geG, (iv) E*(g2,9:)=K(gug2), and (v) SE (gu G92) K (ga 9s) dga 
=K (91, gs). 

Now we introduce a third space of functions. Suppose f, is the semi- 
simple part of f, and c is the centre of f, then {e = {s -+ c and bo = bo N Yo + c. 
Any linear functional on he N Y's may be extended to ġe by setting it equal 
to zero onc. Then the given order on the real linear functions on §, induces 
an order on the real linear functions on hoN Ye The representation o 
restricted to f, is irreducible; let yo be a unit vector belonging to the highest 
weight with respect to the above order. Then, for all hE hy, hyo = A(R) Wo 
where A is a linear functional on ġe Extending the customary language call 
A the highest weight of o. If f(g) is a holomorphic function on W satisfying 
(ae) above set h(g) = (f(g), Yo). Then (a) it pe P., h(pg) —h(g) ; (8) if 
ne N’, the connected group with Lie algebra w =$ CX«, the sum being 
over the positive roots a for which X—« € fe, then A(ng) =h(g); and (y) if a 
is in the Cartan subgroup A of G, with algebra h, then h(ag) = €é(a)h(g) 
with (a) == eAM if a=exp(H). Conversely given a holomorphic function 
on W satisfying (a), (£), and (y) there is a holomorphic function f(g) so 
that A(g) = (f(g),%o). Indeed for fixed g the function W (k) =h(kg) 
on K satisfies (i) W (ak) —=€(a)h’(k) if ae AN K and (ii) R(X)h’(k) =0 
if Xen’. Let be an index for the classes of inequivalent irreducible repre- 
sentations of K and let (w!,(k)) be the matrices of the representations chosen 
with respect to a basis (¢1,°  ",$a,) consisting of eigenvectors of h; more- 
over suppose ¢, belongs to the highest weight. Then h’(k) ~ 2 > ashy (k). 


Using (i) and (ii) it is easily seen that, first of all, a, =0 an Gum 1 
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and then that a,;'=0 unless J==I(c). So W (k) =F ay (i) Set 


f(g) =E ayp; then h(g) = (f(g) Yo); moreover f(g) is a holomorphic 
function of g satisfying (a,) above. Finally the Schur orthogonality relations 


imply that 
J iro ag— f 1E) a9 
G G 


-Í dk Í) (F (kg), Yo) |? dg 


—a fifa) lag. 


This shows that the representation of G on H*(o) is equivalent to the repre- 
sentation ra studied by Harish-Chandra [2(c) ]. 

Now set w(gs,92) = (K (91,92) 0, Yo). This function satisfies (i) 
o(ng,1) =w(g,1) if nE N’, (ii) w(pg,1) =y(g,1) if pe P, (iii) y(ag,1) 
== &(a)¥(g,1) if ac A, (iv) y(ga, 1) = (a) “Y(g,1) if a€ AN K, and (y) 
¥(g, 1) is a holomorphic function on W. But Harish-Chandra ([2(c)], p. 22) 
has shown that there is essentially only one function with these properties so 
HL) lg). 8—W(1,1) and a(g) = (C(g)dobe)M°O. Here £ is 
a representation of G, with highest weight A, and A= A — Ao; moreover Ao 
is so chosen that A vanishes on þe N Ye. > is a unit vector belonging to the 
weight Aj. The function w*(g,0) is a holomorphic function on W with 
values in K,. It may be lifted to a function on W, the universal covering 
space of W, with values in É. the universal covering group of K, É, is the 
product of a simply connected, complex abelian group O with Lie algebra c 
and a semi-simple group. Mapping W into K., projecting on C, and then 
taking the logarithm one obtains T(g) which lies in c. Thus T(g) is a 
single-valued function on W but a multiple-valued function on W. 

Certainly $40 if H? (e) {0}. In particular, if Xg is a root vector 
belonging to the positive root ß, if X_g belongs to — 8 and Hg == [X,— Xg] 
then ([2(A)], p. 612) H*(o) {0} if 28*(Hp) (AH) + p(Hp)) <0 for 
every totally positive root 8. p is one-half the sum of the positive roots. 


3. It will now be supposed that 28> (Hg) (A(Hg) + p(Hg) + 29.(Hg) ) 
<1 for every totally positive root £; p, is one-half the sum of the totally: 
positive roots. Then ([2(d)], p. 610) Ya(g) is integrable and, since o is 
irreducible, K(g,1) is integrable. Let H” (o) be the space of functions in 
H (o) such that f*(z)@(z)f(z) is bounded. Then, if f(z) is in H” (e), 





fi, Enz) € (2a) f (22) dee 
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converges. To verify that it equals f(z.) it is sufficient to show that H? (e) 
contains all polynomials for then the argument of Godement in [7] applies. 
To do this it is sufficient to show that @(z) is integrable over B. This is 
the same as showing that || o (g>, 0) ||? is integrable over G. Let A, be the 
connected group with Lie algebra ay, ([2(d)], p. 583) then ‘every element of 
G may be written as k,ak, with kı, ka € K and a€ A,. Moreover 


| (g>, 0) |? = [o (a, 0) || — lo (A (a)) I? 


([2(d)], p. 599). But | o(h(a)) |]? = tr (o(h?(a))) which is known to be 
integrable. Let Z*(T,o) be the space of measurable functions on B, whose 
values are column vectors of length d, such that o(y,2)f(yz) = f(z) for 


all z in B and all y in T and J. *(2) @(z)f(2) dz is finite, where F is, a 
F . Ri 


fundamental domain for Tr in B. Then 


FO)> SEGOE Od 


defines the orthogonal projection of L?(T,o) onto H(T,o). Now 


Í, K (41, 22) O(a) f(t2)dea— f DE (21, yee) 07 (y, Za) G (42) f (z) dt 
FT 


provided DK (41, y22)o*"(y,22) is uniformly absolutely convergent for z, and 
T ; 
2; in F. To verify this it is sufficient to show that $ K (gi, gay) converges 


T 
uniformly absolutely in some neighborhood of each point (9’1, 92) in GX G. 
Since ø is irreducible it is enough to consider the series >| Wa(giygs*) |. 
T 


Writing g = kak, we have ([2(d)], pp. 598-600) 


| wa(g) | SJ (E (Ha) ho, (a) (ka) ho) PTO | 
SATO, (h(a)). 


Let ¢ be the mapping of G onto the symmetric space G/K and let r be 
the metric on G/K. Every element of G may be written as a product g = hak, 
with ky, ka € K and with a € A, such that loga E apt — {X € ay, | a(X) = 0 for 
all positive roots a}. To be more precise one introduces an order on the linear 
functions on Ap, extends ay, to a Cartan subalgebra of g, extends the ordering, 
and takes the positive roots of this subalgebra with respect to the resulting 
order. Although it is not a priori uniquely determined by g we set a(g) =a. 
We want to show that if e > 0 is given it is possible to choose e, so that if hy 
and hy are in G and r($(hi),$(h2)) <e then | »(log(a(h,) ) —log(a(k.)))| 
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Selv|| for any linear functional y on ap, It is enough to establish this for 
a basis of the space of linear functionals which may be supposed to consist 
of the highest weights of certain representations of @ restricted to ap, Let 
x be such a representation which may be supposed to satisfy +(@(g)) =r*"(g) 
if 6 is the Cartan involution of G leaving K fixed. Then g>r(g)=*(g) 
defines an imbedding of G/K in a manner which we shall pretend is isometric 
in the space of positive definite Hermitian matrices with the Riemannian 
metric #Y--tr(Y!dYYdrf). So it is enough to show that if P, and 
P, are positive definite matrices with maximum eigenvalues As A, then 
|logAi/As| <e if r(Pi,P2) <e (ef. [2(i)], p. 280). If Py—AA* and 


Py A(8ye™)A*, a age Ean then r(P,P)=(NaR)d Let 
i 


" 
| zl] == 1 and || A*z |? = à, ; then, if y = A*r, A, = D ety? > eù. Similarly 
41 
Ar Z ea; 80 — t S IgA/ S — an. 
As a consequence there are positive numbers c and §<1 so that if 


U (g) = {g | r(b(9),6(9’)) <8} then 


eV x,,(h(a(g’))) < o f Tuam, (h(a(9)) dg 


Let U, and U, be compact neighborhoods of g’, and g’, respectively. There 
is an integer N so that for g, € U, and ga€ U, any point in G belongs to at 
most N of the sets U (g1yg:*), yeT. Finally given «> 0 there is a positive 
number M so that if Vu = {g | r(¢(g),¢(1)) ZM} then 


NP Alal) dg <e 
Fu 
For all but a finite set T, of elements of T, UxyU2* G G— Vaini Thus 
Z exp (P(a(gerge7))) )xao((a(guyge))) S Ne 
i 


which was to be shown. 
The kernel X, K (21, y22)o*"(y,2,) is continuous; thus if {wt}, i=1,: -. 
N(T,o), is an orthonormal basis for H(T,o) 
Nc) 
DE (a; 32) a0*-4 (y 22) = 2 wt (#1) 0 (22). 
But 


NT,o) j 
NT,o)= Ÿ Í, Zörle) Gy(e)op (2) dz; 


consequently 


NT, o) = | te EE (2, y2)o** (7,2) Ce) }dz. 
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Following Selberg [5] this may be written 


Sf (E (z ByBa) 0 (88,2) G (2) }dz. 
{7} TAP F 


The outer sum is over a set of representatives of the conjugacy classes of T; 
the inner sum is over a set of coset representatives of the centralizer Ty of y 
in T. Rewrite the last sum as 


SS Í, tr{0 (8, 2)E (Ba, yB2)o*" (yB, 2) G (2) }dz 


MIT 


-3 Í, „EEK (z,y)o* (y,2) G (2) a 


Fy is a fundamental domain for T, in B. Replace these integrals by integrals 
over fundamental domains F’, for Ty acting on @ to the right to obtain 


sf tr{K (g° (0), yg (0) )o** (y, g> (0)) ALTO) )}dg 
fy} By 

= 3 f, E ors 1))do. 
According to [5] this equals . 
Lv(Ga/Pn) J HE (org 1)}dsv; 


Y} 


Gy is the centralizer of y in @; Sy = G/Gy; and the measures are so nor- 
malized that dg = dsydgy. v(Gy/Ey) is the volume of a fundamental domain 
for Ty acting to the left (or right) in Gy. It is of some importance to 
observe that every integral appearing is absolutely convergent. If y is in T set 


xy) =f, CK (gg 1) }asy: 


apart from the arbitrariness of the invariant measure on Sy, x(y) depends 
only on the conjugacy class of y in @. By the Schur orthogonality relations 


xO) =a ff khang" vo yo)dkds, 
=d3 J, f va(kgyg tk) dkdsy. 


4. The first step in the evaluation of these integrals is to calculate ds. 
Now 
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I(E (g, 1) %o,.%0) | =f | (E (g, 1) Yo, Yo) |? dg 
-Í J Mo) Udo Yo) |? dkag 
G VK 
=i { 1E (91yo lèg 


—d> { | K*(9,1)E (9, 1)Yo Yo) ag 
G 
= d (K (1,1) do, Yo) == dd 


which shows that dd | ya(g)I* since || (K(g,1)y¥o, Yo)? = 8° || ya (g) 1. 
But || ¥a(g)|[-* has been calculated by Harish-Chandra ([2(d)], p. 608); it 
equals 


e(@) IL A(Hs) + p(Hs)/p(He)| 


where P is the set of positive roots and c(@) is a constant independent of A. 
To calculate c(G) take o(k) = (det k), kE Ra so that A—=— 2p,; this is 
permissible since, as will be seen in a moment, 28-1 (Hg) (— 2p,(Hg) + p(Hg)) 
<0 for every totally positive root 8. Then 


Il ¥a(g) |? =c (G) IL |—2p.(Hp) + p(Hg)/p(Hg)| = c(@) 


since II |—2p,(Hg) + p( tp) =I |p(Hp)|. To see this observe that 
ep ep 
([2()] > p. 749) one could choose as a set of positive roots the positive roots 
with root vectors in f, and the negatives of the totally positive roots. Let p’ 
be one-half the sum of the positive roots in this new order. Then p’ == p— 2p, 
and 28" (Hg) p’ (Hg) =—2(—8(H_s))“p’(H_s) <0 since — £ is positive 
in this new order if 8 is totally positive. There is an element s in the nor- 
malizer of He in G, which takes the positive roots in the original order into 
the positive roots in the new order; in particular p’(H) = p(s"(H)). Now 
[H,s(Xa)] =s([s*(H), Xa]) =a (s7 (H) )s (Xa) = 8(a) (H)s (Xa) 
and 
Huo = [Zsa Z-a] — [s (Xa), 8 (X-a)] =8 (Ea). 

Now [Hse X sa] = 8 Ha, Xa] =a (Ha) X's) so if all Xa are so nor- 
malized that a (Ha) = 2 then H’s;a) = Hsia Consequently 


| TL 6’ (Hs) | = | TI P (Rw) | =| TI v (s(He))| = | T pe). 
BEP PEP BEP BEP 
On the other hand y(g) = det(u(g+,0)) satisfies (i) y (pg) =y(g) if 
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pE P-, Gi) (gk) —y(kg) = det *(k)y(g) if ke Ko (iii) y(g) is holomorphic 
on W, and (iv) y(1)=1. This is enough to ensure that ¥(g) —ya(g). 
Thus 


Ina f l¥(a) lag 


— f, | dot(u(g,0)) [| dot (a(g, 0)) | TI man 
= 0(B). 
v(B) is the Euclidean volume of B. In conclusion 
x(1) = (—1)'/0(B) JI (Ap) + eH) /e(H))> 


with b equal to the complex dimension of B. 

It will be useful at this point to establish some notation. The universal 
covering groups of @ and K, have been denoted by @ and K,. If G, isa 
subgroup of @ then G, is the group of all elements in @ lying over Gh. 
Elements of @ will be denoted by g and y and their projection in G by g 
and y; similarly k€ K, projects on k. If N is a simply-connected subgroup 
of G then N is isomorphic to the connected component of the identity in N so 
the same symbol will be used for corresponding elements in the two groups. 
Finally gyg* will be written gyg". 

Every element of T is semi-simple [1]; this implies in particular that 
G°, the connected component of the identity in Gy, is of finite index in Gy. l 
The measure on Gy will be so normalized that, on GP, dgy == dg’. Then 
if the measure on 8y? = G/G,° is normalized in the usual manner 


x) = daly: GI ff va korg I) deds’ 


with da = dê. But y, may be lifted to a function on @ and x(y) may be 
written as 


(3) dal@y: 17 Í., Í. ya (gut) dleds,°. 


Recall that ya (g) = (£(9) du, do) HTW). Revising the notation slightly denote 
the linear functions A and A associated to the representation o by A’ and A’ 
and let A be an arbitrary linear function on §, vanishing on §,N¥, and, 
accordingly, let A = Ao +À. da and y,(g), but not ya (g), are still defined. 
Let us now see for which functions, A, the integral converges. 

The function a(g,2) on ŒX B may be lifted to a function p(g,z) 
on GB with values in K, which satisfies u(g1, 922)u(9,2) = (9gs 2). 
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Perhaps the simplest way to see this is to observe that if z == p, p€ P,, then 
p% is in W—P_K,B+ ([2(c)], p. 5) and so is p*g* = pkp”, p, € B; then 
p(9,2) =k. In particular „(kıgk,, 0) — %u(8,0)%, so that 


T (highs) =T (k1) + Tg) +T (ee). 


Now write g—kak, with amexp( Sh (Xn + Zn) ({2(4)1, p. 599). 


It is possible to choose a basis {c,,- - *, Cs} for c so that the coordinates of 
T(#,) and T(k:) are purely imaginary and those of T’(a) are of the form 
> log (cosh 4)ay with ay20. If the basis is chosen from i(c NY) the first 
con dition is satisfied. The second will be satisfied if we choose a basis so 
that the projection of Hy, t= 1,: - ',s, on the centre has positive coordi- 
nates ([2(d)], p. 600). It will be enough to show that this can be done 
when the group is simple and c has dimension 1. But 2p,(Hy,) >0, 
tel,‘ ',s, and 2p,(H) is determined solely by the projection of H on c 
since it is the trace of the representation of f, on p, Since Hy, € the 
assertion is proved. It will be shown below that for fixed » the imaginary 
parts of the coordinates of T(gyg*) remain bounded as g varies over G; 
consequently the integral over 8° converges absolutely if Re{A(c) —’ (a) } 
> 0 and represents a function of A which is continuous on this set and holo- 
morphic in its interior. Thus it will be sufficient to evaluate the integral 
(3) when A(c) is real and very much less than zero. 

We now establish the improved assertion. The notation of [2(d)] will 
be used. In showing that the imaginary parts of the coordinates of T(gyg>) 
are bounded we may suppose that g = k, exp(X)k, with X € ap and #, and kz 
in some fixed compact subset of K. Suppose r(k) is the result of projecting 
% on the centre of É, and then taking the logarithm. Then 


T(g9g*) =r (p> (exp (X) kay hs exp(—X), 0) 
== — r(n(exp(— X),0)) —r (u(y, krt exp(—X) (0))) 
—m(p(exp(X), kaytkstexp(— X) (0))). 


The first term gives no contribution to the imaginary part. „(y,z) is 
defined for z in an open subset of p, containing the closure of B so it is 
possible to define p(y,z) on the same set. Since it is continuous it takes the 
closure of B into a compact set. Thus only the third term causes trouble. 
So we consider „(exp(X),2) letting z vary over B. 

The calculations will be simplified if we first prove a lemma. Every 
element X of p, determines a linear transformation from p_-to fe namely, 
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T(X)Y=[X,Y] if Yep. Introduce on p- and f, the Hermitian inner 
product — B (Y, 0 (Y) ) then 

Lemma 2. B is the set of vectors X in p, for which 21 —T*(X)T(X) 
ts positive definite. 

If k is in K then 

T(k(X)) =Ad(k)T(X)Ad(k*) and 

T* (&(X))T(k(X)) == Ad(k)T*(X)T(X) Ad(k*) ; 
moreover X is in B if and only if &(X) is in B. So in proving the lemma 
we may replace X by any element equivalent to it under the adjoint action 
of K. Suppose X is in B then X may be supposed equal to Sax, with 
i 
—1<a,<1. Any element of p_ may be written as 
i= Zant È baXa + BB baka. 


; aePy 4<J ME Pay 
Then 


[x,¥]— ZabılXy, XJ +d > bal La La] +2 2, aybal X y X-a]. 


45 aePı 
It is easily seen that B(Xa,6(Xg)) —0 unless a =£ and that [X,,Y] is 
orthogonal to [X,,,¥] if +547. Moreover H([Xy,X_a]) = [Xy Xa] and 
—B([Xyo Xa], [Xu £8]) =—B([[Xy,, Z-a], X], Xp) 
—— B([Hy,, Xa], Xa) 
=a (Hy) B (Xa Xg). 
Since a (Hy,) == 0, 1, or 2 it follows that || T(X)Y |? <2 || F |?. Conversely 
suppose X € p, and || 7(X)Y |? <2 || ¥ ||? for every Y in p.. If X = S aX, 
with a, real, as may be assumed, then ||[X, X_,,]||? = 2a} || X_,, |? 5 that 


|a| <1. It follows that X is in B. 
Similar calculations now show that if 


KK, +3 a baka + È È baXa 


i<j mE Py 


is in B then |a|<1,t=—1,:--,s 


The original assertion will be proved if we show that the imaginary 
coordinates of r (u(exp(t(Xy, + X_y,)),z)) remain bounded as z varies over 
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B. Let z=exp(X,) with X, as above and set g(t) = exp (t(Xy, + X-,)). 
Write 


Xom $, GeXa+aXy, + Y laXa m= X, +X, +£: 
aeS: < afs 
t 


where S; is the set of roots which vanish on Hy, Then g(t)exp(Xo) 
= exp(X.)g(t)exp(X,)exp(X3). g(t) and exp(X,) belong to the complex 
group whose Lie algebra is spanned by Hi, X, and Xy, A simple calculation 
in SL(%C) shows that g(t) = exp (a(t) Xy) exp (b (t) Hm) exp (c(t) X.) 
with 

a(t) = (a, cosh t + sinh t) (a, sinh ¢ + cosh t)-t 

b(t) = — log (a; sinh t -+ cosh ¢) 

c(t) = sinh ¿(a sinh t + cosh t). 
Finally 

exp (¢(t)X_,,)exp (Xs) =exp(X,)exp(X,) 


with X, = Ad (exp (— Xa) ) (c((#)X-y,) so Xe—c(t)X»,+ DeaeXa. The 
sum. is over the positive compact roots. This implies that exp(X,) is the 
product of an element in K”,, the semi-simple component of K,, and an element 
in P.. So 


(un (g(t), 2) ) = x (exp (b(t) Hy,)) = — log (u sinh t + cosh t)a(exp(H,,)). 
The coordinates of r(exp(H,,)) are real and, since | a| <1, 
Re(a,sinh ¢ -+ cosh t) > 0 so —§ < Im(log(asinh t -+ cosh t) ) < §. 


It will be seen that for A(q) <<0 and y semi-simple the double integral 
in (3) is absolutely convergent; consequently in our analysis the integral 
over K may be omitted and y need not belong to I. 


5. It will be convenient in the evaluation of the integrals (3) to omit 
at first any detailed estimates. These will be discussed in the next paragraph. 
Suppose that y is a regular element in @ and let y belong to the centralizer 
B of the Cartan subalgebra j of g. According to [2(e)] it may be supposed 
that 6(j) =j. Hence j=j, +j: with ,=jNf and j-—jMp. The case 
that „== {0} will be treated first. Then BC K and it may be supposed 
that j=}. G,CK and the measure on Gy is so normalized that the total 
measure of @,° is 1. The integration over S,° in (3) may then be replaced 
by an integration over G; as will be seen below the integral is then a con- 
tinuous function of y as y varies over the regular elements in X. Harish- 
Chandra has shown that if Ta is the character of the representation =, then 
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Ta) =a f dot fo Hadya (ggg) da.) 


when f is an infinitely differentiable function with compact support. If the 
support of f is contained in the set of regular elements in GKG- the order 
of integration may be reversed. Another formula for T,(f) is implicit in 
the papers [2(c)] and [2(e)]. However before introducing this it must be 
observed that B is connected and thus every element of B can be written as 
the exponential of an element in h. In particular, let j—exp(H). Then 
T,(f) is obtained by integrating f against a continuous function whose value 
at y is l 
{ Il (et) — gta) } 1 > e(s) e AEs), 
aepP acw 


P is the set of positive roots; w is the Weyl group of K,; and e(s)= +1 
according as s is the product of an even or odd number of reflections. It 
should be observed that the second hypothesis of Section 10 of [2(e)] does 
not hold here so it is necessary to prove Lemma 43 using Fourier integrals 
rather than series. The value of x(y) obtained agrees with (2) since By 
is reduced to a point with v(B,) 1, Py is empty, and wy is reduced to {1}. 

Retaining the assumption that y is regular it will now be supposed that 
je {0}. Define the subgroups M and N as on page 212 of [2(g)] with j 
replacing 5, then ([2(g)], p. 216) l 


ds, -f levnyn-*mn-*k-*) dkdmd 
S E A a ai OE Lk sa cc 


if the Haar measures on M and N are suitably normalized. It should be 
observed that, contrary to the assertion in [2(e)], the centralizer B in G of 
a Cartan subalgebra is not always commutative. Thus, if y belong to B one 


must consider f att gyg*) dg and not f f(gy¥97*) dg; B is the projection 
a 

of B on G and B® is the. connected component of the identity in B. The 

theorems of [2(h)] used later must be interpreted with this observation in 

mind. It is not difficult (cf. [2(a)], p. 509) to see that the above integral 

equals 


&(Z)(y) S casey Qs (Enmymk) dkdman 


with €(X;,)(y) equal to the determinant of the restriction of I —ad(y) to n, the 
Lie algebra of N. It can be assumed that jz is contained in ap. Then, in the 
notation of [2(d)], for some 2 either v!(X,,) or v7(X_y,) is in ty. Since 
the order on ja is arbitrary suppose that v?(X,,) is in ne 


vi (Xy) =$ (Xy — Xy — Hy) and Riv (Xy) =X 
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is ing and thus in n. Let N, == {exp(tX)]|_o<t<o}; N, is a closed 
subgroup of N so the above integral may be written 


&*(y) f “alk exp (tX)nmymk*) dt} dkdmdi. 


maces = 
To show that x(y) =0 it is sufficient to show that the inner integral is 
identically zero; this will be done using Cauchy’s integral theorem. Recall 
that 
a(kexp(tX)nmym*k*) = (Ef) &(exp (tX) )¢(nmym =k) po, po) ATW) 

with g = exp(tX)nmym*. The first term is clearly an entire function of t. 
P(g) =——r(p(mym int, exp(—1X) (0))) —r(u(oxp(—tX),0)). For m, 
y and n fixed the first term is defined, bounded, and analytic in ¢ so long as 
exp(—tX¥)(0) is in B. If it is observed that the sub group of G, whose 
Lie algebra is spanned by Hyp Xy, and X_,, is the homomorphic image of 
SL(2,C) then the calculations may be performed in this group. Now 


—i i Ih á t 
2-(7; ;) exp(tX) =( oe) 
and 


146 —t\ (1 —i#(—#)“\(U1—#)+ 0 1 
( ti i Ar: 1 \( 0 a ae 
Thus exp(—tX) (0) =—it(1— it) tX, is in B if | i#(1—#)*| <1 or 


Im(t) >—} and —x(u(exp(—tX),0)) = log(1—ti)w(exp(Hy)) is 
analytic in the half-plane Im(£) >—+4. Moreover, in this region 


| ya (k oxp (tX )nmym kt) |< c(1 + |e |)" | 1 — ti pEr 
=c(1+]|2|)” 


if AH.) <<0. n is a positive integer. Here and in what follows c is used 
as a generic symbol for a positive constant. Cauchy’s integral theorem may 
now be applied. 

Suppose y is singular. y belongs to the centralizer of at least one 
Cartan subgroup j of g; j may be taken so that @(j) —j. Let gy be the 
centralizer of y in g, then d(g,) =gy. Consequently gy is the direct sum 
of an abelian algebra a and a semi-simple algebra gı. Let j, be a fundamental 
Cartan subalgebra of g: ([2(g)], p. 236). Then j,-+a is a Cartan sub- 
algebra of g which may be supposed to equal į. Let B° be the connected 
component of the centralizer of j in G. Then 


8 = 
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SS Se 
— Jarod”. FRAU DAL 


if G, is the connected group with Lie algebra g, and B,—=B°NG,. The 
measures are so normalized that dg = dg*db and dg,°—dg,*db, db being 
the Haar measure on B°. Moreover Gy? is the homomorphic image of G, X A 
where A is the connected group with Lie algebra a. The measure on G,° is 


so normalized that J Fg) dg = f f(g.a)dg.da. Finally let B,° be 
GP GıXA 


the connected component of the identity in B, and write the above integral as 
Bi Bef af, Fg) dq. 
Gar? * G/B: 


Choose y, close to the identity in B so that yy, is regular then 


B,: B? i DL dse f -lg-l) | = 
(4) (Bur Bel |, fd 


If G, is any connected semi-simple group with finite center, B, the 
centralizer of a Cartan subalgebra j, of gy, and m(g,) a function on G4, the 
universal covering group of G,, a function can be defined on B, by 


bmn) = Ala) f mlonge) ag" 


when the integral exists. To obtain A,(7.) map G, into the simply connected 
complex group whose Lie algebra is the complexification of gı; let y go 
into yı and set y„=exp(H,.)with H, in the complexification of jı Then 
Ay (94) = eu) TT (etw —1); P, is the set of positive roots with respect 
aepP 
to some order on j, and p, is one-half the sum of the roots in P,. For every 
a € Pı, Ha defines an invariant differential operator Da on By; set Dy == II Da. 
aeP 

Harish-Chandra [2(h)] has shown that if m(g,) is infinitely differentiable 
with compact support then 


lim Dim (34) =am(1). 
yrl ; 


a is a constant independent of m and a £ 0 if j, is fundamental. To be more 


precise ¢m(y:) is defined if y, is regular and the limit is taken on the set of 
regular elements. 


Apply this result formally to equation (4) with f(g) = daya(g) and 
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m(gı) = daya (gyg:g*™). If B° is not compact the left side is 0 and one 
obtains l . 


f Aya (gyg*) day? — 0 
alap 


so that x(y) =0 if y has no fixed point in B. If B° is compact it may 
be supposed that j==ġ and that jı=iNgı. In this case B, is connected. 
If yx = exp(H + Hı) then 


af dapa (gg) dsy? 
alae ar 
= lim D,{( II (29E) — e3e(#+4)))-2 S e(s)esA(A+Hd+sp(H+EN))}, 
A,>0 a ne f ; sew 


if the total measure of B° is 1 as will be assumed and if an order on j, is so 
chosen that the positive roots are just the positive roots of į whose root vectors 
lie in g1,.. The denominator is regular at H, == 0 and is invariant under the 
Weyl group of gio. Thus, as on page 159 of [2(h)] the right side equals 
(IL (2000 — e30) )- lim D,( De(o)er immun) 
ote Hyo 8 


The second term equals 
w, J «(s) IL (sA (Ha) + sp (Ha) ) e8400 ; 
sl aePy . j A 


w, is the Weyl group of $e N Buo and w is its order. The sum is over a set of 
representatives of cosets of w, in w. It remains to calculate a. Since, as is 
easily seen, every non-compact positive root of gz, is totally positive G, is 
locally isomorphic to the product of a compact group and the group of pseudo- 
conformal mappings of a bounded symmetric domain By. A, and wa,(g1) 
may be defined in the same manner as A and ¥,(g); the compact component 
causes no difficulty [2(c)]. Apply the limit formula of Harish-Chandra to 
dar ($s) to obtain E 


ada, = lim D { $ e(s) est Hd+tsP (E) } 
. Hı>0 ; ew 
=o I (A: (He) + p:(Ha)) 


if the total measures of B,° is 1 as may be assumed. If the measure on G is 
normalized in the same way as that on @ then 


du = (—1)%/o(By) H (Ai (Ha) + pı(Ha)/pı(Ha)) ` 
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if by is equal to the complex dimension of By. a is now easily determined; 
setting P, = Py, pı = py, and w, = Wy the value of (3) is found to be 
(—1)?*/v(By) {Gy 0y] II py(Ha) II (P00 — ot) J 
ae Py ad Py 
= «(s) HL (sA (Ha) + 8p (Ha) ) ott 


x2 10 


and (2) is established. It should be observed that since the total measure 
of both B° and B,° must be 1 the measure on A, and thus on G,°, is com- 
pletely determined. 


6. The prime task of this section is to justify the above application of 
the limit formula of Harish-Chandra. The truth of the other unproved 
statements above will become evident in the course of the justification so there 
is no need to mention them explicitly again. @ will now denote a connected 
semi-simple group with finite centre and @ will denote its universal covering 
group. All the other standard symbols will also refer to @. 

In particular a, will be a maximal abelian subalgebra of p. If {H;} is 
a basis for a, and if g = k, exp(H)*, with H = > tH; set t= (g). (&(g)) 
is not uniquely determined by g. Let w(k), for k € K, be the determinant of 
the restriction of I—Ad(k) to p; then — 


Lemma 3. There are positive constants e, c, and q so that 
8 & 

exp( È | t(gkg*)|) =c] o(k)|texp(e S| t(g)|)- 
4=1 4=1 


If A= (Ay) is any matrix set |A |— (>| Ay, |?)% and if ge @ let 
tj . 


|g | =|] Ad(g)] where Ad(g) is the matrix of the adjoint of g with respect 
to a basis of g orthonormal with respect to the inner product — B(X,6(Y)). 
It is easy to verify that 


(5) cx exp (8: È 4(g)|) 2 Ug 1S OT BETON) 


for some positive constants Cı, Ca, Bu and fs. Now it is sufficient to verify 

the lemma for g=-a—exp(H). If Ad(k) = (a4) with respect to a basis 

which diagonalizes a, then || aka" ||? == I Au Dg,2. The ày are linear func- 
i 


j 
tions on a,. For a fixed k with o(k) 70 this must approach infinity with 
Ela] ([2(h)], p. 743). Let S(H) be the set of pairs (ij) for which 
421 
Ay(H) > 0 then 


sy 0 
(47) EStH) 
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unless o(k) =0. Moreover, for some small positive number e(H), (15) € S(H) 


8 Ld 8 
implies Ay(H) > 8e(H) È|]. Lo M= {E= SiH |S 4[—1). eH 
is in M there is a neighbourhood 7(H) of H in M so that if H’ is in U(H) 
and ¢ > 0 then || exp(tH’)kexp(— tH’) |° Zexp( (Hy |W)){ I sf} 
1 (49) €8(H) 


Since © a? vanishes only when »(k) vanishes the theorem of Lojasiewicz 
(14) 8 


[4] implies that there are positive constants c(H) and q(H) so that 
( È u) = o(H)| o(k) | 
AN €8(H) 
for all k. All that is left is to observe that M is compact. 
Suppose y is a semi-simple element of G. Define Gy, G,°, Gu, and so on, 
as before; however it is no longer necessary to suppose that j, is fundamental. 
Then 


(By: By] J, fra J do? J, gf (oa) * da. 


If A, (y1) and D, are defined as above we are to show that 


(6) lim DyA, (94) f ds, È vgygiyngrtg?)dg.* . 
yri Gia, By 


e Gy 
, =a f ¥ (9797) dsx. 
: GIG? 


y is chosen so that yy, is reguar and the limit is taken in the manner 
previously indicated. Of course it will be necessary to impose some condi- 
tions on the function y. If y is infinitely differentiable with compact support 
then for y, in some compact neighbourhood of the identity the inner integral 
on the left, a function on @/@,°, vanishes outside some fixed compact set U 
([2(h)], Thm. 1). Moreover 


Dam), KALI EU BD 


converges uniformly on U to ay(gyg*) ([2(h)], Thms. 2 and 4). This 
shows the validity of (6) for functions with compact support. To establish 
it for another function y it would be sufficient to show that for any «>0 
there is a sequence {4;(g)} of infinitely differentiable functions with compact 
support such that l 


A : ena =D = * 
(Himsa) f° Hamas Dia) J, yarns) ag 
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uniformly in y and 


(ii lim | par), ya. 


yı is, of course, to lie in a fixed compact neighbourhood of the identity and 
be such that „u is regular. 

In order to establish the existence of {y4} it is sufficient to assume that 
y is infinitely differentiable and that there is a sufficiently large constant « 
such that, for any left-invariant differential operator D on G, | Dy(g)| 


Se(D) igh" 

Once it has been verified that this condition is satisfied by y,(g) when A 
is real and A(H.,,) << 0 there will no longer be any need to refer specifically 
to this function. For convenience,-if Xeg we denote the differential 


k 
operator Sa exp(tX))]:-o by X. It may be supposed that D = [Į] X; so that 
d=1 


Dya (g) = DENE po) AT) = Z Do (Eg) bos po) Draw); 


a runs over the subsets of {1,---,k} and Do = 11 Xs with the order of 
the X,’s left unchanged. øo’ is the complement of o. Now Da(£(g) bo $0) 
== (£(g) IL E(X) $0; po) so there is no doubt that 
tea’ 
| Do(£(g) bo, $0)| Se(Do’) | g |™ 
with some constant #,. To find Dee") we must differentiate 


exp(A(T(g IT exp (&X.))) 


with respect to each of the variables and evaluate the result at the origin. 
But T(g I exp (4X4) ) = — r(u( dex (— tha) -1,0)), the prime indi- 
cating that the order of the factors is reversed, and this equals 


—r(p(g*,0)) — 7 (a( II exp (— bs), g*(0)). 


There is an open neighbourhood U of the identity in G, and an open neighbour- 
hood V of B, the closure of B, such that h € U implies A*(V) Cp,. Conse- 
quently »(h,z) is defined and analytic on UX V. So is r(p(h-4,2)) and 
its derivatives at the identity are bounded functions on B. Thus 


| Ds, aT@) | <c(D.)| AT@) | ; 


but [ATW | S o(ayexp( S| Alg) lA CEn)) ([2(4)], p. 600). Thus, if 
(Hy) << 0, t=1,- 1,8, 
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| Dee) | S e(Do)exp(— a: 3 | (9)1) 


with a, large and positive. These remarks and formula (5) show that the 
assumption is satisfied. 

We shall need a non-decreasing sequence {¢,(g)} of infinitely differ- 
entiable functions on G@ with compact support satisfying conditions: («) 
lim ¢i(g) = 1, (8) there is a non-decreasing sequence {U,;} of open sets 
Which ehemals gue lO Ui, yak an a lett an 
differential operator on G then | D&(g)|<c(D) for alli and g. We write, 
after Iwasawa, == KHN. If {X4} is a basis for g and if (ay) is the matrix 
of Ad(hn) with respect to this basis then 


d 
Xd ihn) = Sane f (k exp (1X) hn) 
= 2 anf (Ahn; Y}, 24) 
if Xj=¥5+Zy Y,efandZ,eb+n. ED, is a left invariant differential 
on K and D, a right invariant differential operator on HN then f(¢;D,, D2) 


is the result of the successive applications of these two operators to f con- 
sidered as a function on K X HN. In particular, 


d 
f (khn; 1, Z4) — zg Fk exp (tZ) hn) |i. 
Iterating we obtain 
Df (thn) = 3) g(hn)f(khn; Dit, Dot) ; 
; j 


gi(hn) is a polynomial in the coefficients of Ad(hn). If X€h+n and 
X=% +X, XE b, X,€en, then 


-f (exp(tX)hn) = Fi p(X) hn) +Š ICh exp (th= (Z) )n). 


Consequently 
Df (klin) = F, gi (hn, h) f (khn ; Dy, Dat, Ds*) ; 
F 


D,* acts on K, D; on H, and D, on N. gi(hn,h*) is a polynomial in the 
coefficients of Ad(hn) and Ad(h+). The functions ¢;(g) are to be con- 
structed as products gi(khn) == pr (k)? (h)pë(n). Since the coefficients 
gi(hn, h™) are independent of & we need only require that {$i (¥)} satisfy 
(a), (8), and (y). This requirement is easily satisfied since X is the product 
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of a vector group and a compact group. H is a vector group and the coefficients 
gı(nh, h>) are exponential polynomials on H so we need only require that 
{$i?(h)} satisfies («) and (8) and that the derivatives on œ; (h) go to zero 
faster than any exponential ‘polynomial uniformly ini. N is a closed subset 
of the space of endomorphisms of g and the functions g;(hn,h) are poly- 
nomials in the coefficients of Ad(n). Thus the functions &°(n) can be 
obtained as the restriction to N of a sequence of functions on a vector group 
which satisfies («) and (8) and such that the derivatives of the functions 
go to zero faster than any inverse polynomial uniformly in i. 

Now set yu(¢) —di(s)¥(g). To establish (i) it is sufficient to show 
that for any invariant differential operator » on B 


O limma) f pld = a) | vom) dg 


uniformly in y on any bounded subset (i.e. a subset with compact clogure 
in B) of the set of regular elements in B. A(y) is defined in the same 
manner as A (yı). To obtain (i) from this relation it is sufficient to set 
vem D, and to observe that Ai(+,)A™ (gu) is regular at »,—1. 

If M and N are the groups introduced on p. 212 of [2(g)] then 


A) J pp OTI =A Cy) (HNC) f ylennyt) ddan 


Let S be a finite set of invariant differential operators on B and let } be 
the maximum degree of the operators in 9. Let 8 belong to S and let D be 
a left invariant differential operator on G. 8 determines in an obvious fashion 
a left invariant differential operator on G which will be denoted X. Then 


| 8( Dy (lenmeym-2he) )| == | Ad(km) (8°) Dy (knmym-the*) | 


S | km |+ c(D) || nmym | 
and 


| 8(Dy(knmym-*-)) — 8 (Dy,(kamym*k)) | < || km |! o(D) | nmym= j 


Moreover there is an increasing sequence {Y;} of open sets in N X M, which 
exhaust N X M, so that the left-side of the latter inequality is zero if 
(n, m) € Vi 

Recall that B° is the connected component of the identity of the centralizer 
in @ of a Cartan subalgebra į and that #(j) =j. An examination of the 
form of the matrices of Ad(mym”*) and Ad(n) with respect to a basis which 
diagonalizes jNp shows that |nmym>] = |mym"||. Thus | amym |- 
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< || mym | |nmym j1 if a, -+ a=. Now y may be written as 
yy With y€ BOK and »,¢ exp(inp). Then 

| mym | yt 7 rey | Se oy) | ye Im Us 
here w-(y-) is the determinant of. the restriction of I—Ad(y_-) to mnp 
and c, q, and e are positive constants. Thus 
| km |? | nmym | Sc | w_(y_) [CORD | yt [9% | m [ee | a [foes 


consequently 


(9) S, [8(Dy(bumym-*i+)) | dkdman 
, Elle Sm Iren am fm yan 
an 


(9) | f | 8(Dy lenmt") ) — $( Din (knmym7k*) )| dkdmdn 
~ KXMXN i . 


S o(D)| u(y.) erea yyt jere ffm perea | n [-edmdn, 


Now it can be shown (cf.-[2(g)], Cor. 1 to Lemma 6) that the integral over 
N in (8) converges if a, is sufficiently large. Then, fixing œz, we can choose 
a, so large that the first integral converges. Moreover, by the dominated 
convergence theorem, the integrals. in (8) converge to zero as 4 approaches 
infinity. We eonclude first of all that 


a) =) S gordo 


is defined on BP— {ye B | w(y-) 40} and is the uniform limit on compact - 
subsets of B’ of the sequence {$y,(y)}- - 
There is a finite set {v1,°.: *, vw} of invariant differential operators on 


B so that any other v, may be written as v = Sem where the u, are invariant 


under the Weyl group of ge ([2(£)], p. 101). "For each uy there is a left and 
and right invariant differential operator D; on G so that upy, (+) — py, (+) 
({2(h)], p. 155). Then 


Udy, (x) TE = Yon (+) . 


The right side is a sum of terms of the form 


(y) Scar oe (Dia (knmym ke) ) dkdmdn. 
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$ (y) is a regular function on B; 8 is one of a finite set of invariant differential 
operators on B; and D is a left and right invariant differential operator on G. 
As a consequence of the estimates above the sequence {v¢y,(+)} converges 
uniformly on compact subsets of B’ and it must converge to vdy(y) so 


| ody la) — voy (+) | | o- (y-) [Mero (a, i) 


on any fixed bounded subset of B’. Moreover limc(v,i) —0. The proof of 


i> 
(7) can now be completed by an argument essentially the same as that on 
pp. 208-211 of [2(g)]. There is no point in reproducing it. If we show 
that 


(10) Sg) an’ 


is absolutely convergent then a simple application of the dominated conver- 
gence theorem suffices to establish (ii). Choose a maximal abelian subspace 
of gı N p and extend it to a Cartan subalgebra jı of gi, then j=j, +a is a 
Cartan subalgebra of g and #(j) =j. We again-introduce the groups M and 
N. Tf 1 is the Lie algebra of N let nı =n N g, and let N, be the connected 
group with Lie algebra nı. Lf na = (I—Ad(y))n then, according to Lemma 
7.0 of [1] every element of N may be written uniquely in the form exp(Y2)m 
with n, € N, and Y€ ng. Then if B, is the connected group with Lie algebra 
jN p every element of G may be written uniquely as g == k exp (X )exp(V’2)n,b, 
with Xemnp, m being the Lie algebra of M, and b,€ B, (ef. [2(h)], p. 
215). Let $o(110,) be a non-negative function on N,B, such that 


f po (nıb) dn db, = 1, 
NıB+ 


and set $(g) = | exp (X )exp (F+) |f do(mb,) if g —kexp(X)exp(Ys)mby. 
8 is a suitably chosen non-negative constant. Then a function may be defined 
on G/G,° by 


659°) = J (990) dr; 


sy” is the coset containing g. We shall show that if 8 is sufficiently large 
then ¢(sy°) is greater than some fixed positive constant for all s,°. It may 
be assumed that g = k exp(X)esp(Y:). If Ky is the connected group with 
Lie algebra EM gy and if gu =K exp(X’)exp(Y.’)m’b,’, u€ Ky, then 
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(8°) — + (gun.b,)dudn,db, 
EyXNiXBy mat 


= f fexp(X’)exp(¥,) IP entered. 
Enr . 


Suppose fi(m) and fz(2,) are two non-negative functions of the variables z, 
and z, and z, and 2, are subject to some relation. We shall write-f, >fs 
if there is a positive constant c and a non-negative constant 8 so that 
off (21) 22 fe(2a) for all pairs (2,22) satisfying the given relation. The 
assertion will be proved if it is shown that | exp(X’)exp(Y4.’) || > ertog», 
If H,€ {Op then 2p,(H*) is the trace of the restriction of Ad(H,) to nı 

Since | exp(X)exp(¥) | = | exp(X’)exp(¥s’)m'b,’ | it is easily seen, 
after choosing a basis of g which diagonalizes į N p, that || exp(X)exp(Y) || 
= || exp(4’)b,’]. If a is a maximal abelian subalgebra of mop then 
a -+ ({M p) is a maximum abelian subalgebra a, of p. Let X’—k_(H_) 
with HEa.andkEeMNK and let b/=exp(H,) with H,einp. Ha 
is the restriction of a root to a, then 


log || exp(X)0,’ || 2 | «(H+ H,)|; 


since the restrictions of the roots to ay span the space of linear functions on 
a, there is a constant c so that for any linear function A... 


e [A log | exp(X’)b," | = |A(H_+ HJ]. 


Since a.n (inp)= {0} it is'now clear that || exp(X)exp(¥,)|| > || 6,’ || 

and || exp(X)exp(¥:)|| > || exp (X) |. From this one easily deduces that 
| exp(X)exp(¥s) > Jexp(Ya’)my |. If ny’ —exp(¥v/) and exp(¥s'exp(¥1’) 

=exp(Y’) with Y,/€ n, and Y’¢€n then the four variables (Y,’, ¥.’), Y’,. 
(Ad(exp(Y.’)), Ad(exp(¥.’)) and Ad(exp(¥’)) are polynomial functions 

of each other (cf. [2(h)], pp. 737-738 and the reference cited there.) Conse- 

quently |jexp(¥’)] >| exp(¥,’)| and Jexp(¥4) | >[exp(¥,’) || so that 
| exp(Z)exp(¥,)| > exp(¥1’)| and | exp(X)exp(¥;)|| > J exp(¥z)] How- 
ever if n,/0,/u7 = wb; tn then 


kexp(X)exp(¥Y2)m:b, =K exp(X’)exp(Ys/)u’ 


and the argument may be reversed. Consequently | exp(X’)exp(Y¥’) || >i 8.’ | 
> ezeillog be), i . 
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The absolute convergence of (10) will be established if it is shown that 


Í, |y (gx9>)| (g)dg 


converges. However this integral equals 


f A y(kmnyn tm th) | $(lemnb,) dedmdndb,. 
EKXMXNXB, 


If n==exp(Y,)n, as before then dn=-dY¥.dn, where dY, is the Euclidean 


measure on n, and this integral equals 


f i (km exp (Yn) yexp(— YF) mk) | |mexp(Y,) |? dkdmdY >. 
KXMxXte i 
The integrand is less than or equal to 
c || (mexp(Ya)y exp (— Va) y*m*) mym |“ | m |P || exp (F2) |P 
S c | exp(¥.)y exp (— Fa) yt [-% || m |?“ | mym |- || exp (F) | 


if a+ &:=4a, o%,0,220. It follows from Lemma 8 of [2(h)] that 
| mym | > || m || and from Lemma 2 of that paper that 


 fexp(Fa)yexp(—Fa)yt | +141 Ya lh 


Thus if « is sufficiently large the integrand is less than or equal to a multiple 
of (1+ | Xal) || m |- with 8, and 8, large. Consequently the integral 
converges. It should be observed that y is fixed so that uniform estimates 
like that of Lemma 3 are not necessary. 
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SEPARABLY GENERATED SPOTS AND AFFINE RINGS 
OVER REGULAR RINGS.* 


By Lovis J. RATLIFF, JR. 


1. Introduction. The results in this paper are generalizations of some 
results in [2] and [5], and the notation and terminology is the same as in 
[5]. In particular a Noetherian domain I is said to satisfy the condition 
(SF) if each separably generated affine ring o over J is such that the integral 
closure of o in its quotient field is a finite o-module. It is well known ([8], 
p. 267) that a field satisfies the condition (SF), and recently Nagata ([2], 
p. 419) has proven that a Dedekind domain satisfies this condition. Nagata’s 
proof is essentially based on the following facts. 


1.1. Let o be an affine ring over J, and let o* be an integral domain 
which contains o and is a finite o-module. If p* is a prime ideal in o*, then 
rank p* == rank (p* N 0). 


1.2. If P is a separably generated spot over J, then the integral closure 
of P in its quotient field is a finite P-module ([2], p. 416). 

It is known ([2], p. 414) that if a local domain P is analytically unrami- 
fied, then the integral closure of P in its quotient field is a finite P-module. 
Hence statement 1.2 above is a consequence of 


1.3. If P is a spot which is separably generated over J, then P is 
analytically unramified ([2], p. 416). 

In an earlier paper [5] the author proved that a rank two regular local 
ring I which has an infinite residue field satisfies the condition (SF). The 
proof was somewhat complicated by the existence of spots of type one, and 
the condition of an infinite residue field for J was necessitated to handle this 
case. In the current paper no classification of spots into type one or type two 
is needed. By proving a preliminary theorem (Theorem 3.1) on analytical 
unramifiedness of spots dominating regular local rings, the dichotomy of 
spots is avoided in this paper and the restriction on the rank (<2) of a 
ground ring is also removed. 

A regular Noetherian domain 7 of finite rank (if p is a prime ideal in J, 
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then I, is a regular local ring) is a ground ring. By using some results in, 
[3,4] it is proven in Section 2 that if o is an affine ring over J and if q is a 
maximal ideal in o, then trd (o/I) = rank g—rank(q N I). Corollary 2 of 
this theorem is the generalization of statement 1.1 above to the case where 
I is a regular Noetherian domain. In Section 3 it is proven that statement 
1.3 above holds when I is a regular Noetherian domain of finite rank, and 
hence Nagata’s proof that a Dedekind domain has the property (SF) carries 
over verbatim to prove that a regular Noetherian domain of finite rank has 
the property (SF). 


2. The rank of an affine ring over a ground ring. As stated in 
Section 1 the statement that J is a ground ring is to mean that I is a rank n 
(0<n<oco) regular Noetherian domain. 

Nagata [3,4] has proven two theorems. which are stated as Remark 2.1 
for future reference. 


Remark 2.1. The second chain condition holds in a Noetherian domain 
J if and only if the first chain condition holds in the derived normal ring of J. 
Further, if J satisfies the second chain condition, and if P is a spot over J, 
then P satisfies the second chain condition and the dimension formula. 


Lemma 2.1. Let I be a ground ring, and let p be a prime ideal in I. 
Then I, satisfies the dimension formula and the second chain condition. 


Proof. It is known ([Y], p. 187) that a regular local ring Ty satisfies 
the first chain condition. Since I, is a normal Noetherian domain ([9], . 
p. 302), I, satisfies the second chain condition (Remark 2.1). Since Jy is a 
spot over I, I, satisfies the dimension formula (Remark 2.1), q.e.d. 


Remark 2.2. Since I= n Ix, where M is a maximal ideal in I, and | 
since Jj, is a normal domain, Ti is a normal domain. 


The proofs of the following theorem and corollaries are the same as given 
in [5], hence are omitted. 


THEOREM 2.1. Let o = I [z  ",2] ‘De an afine ring over a ground 
ring I, let q be a maximal ideal in o, -and let re: Then trd(o/I) 
= rank q — rank p. 


COROLLARY 2.1. With the same notation as in Theorem 2.1, if 
(0) qo Ch C+ -C qq ts a masimal chain of prime ideals in o, then 
s =rank q. l 
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COROLLARY 2.2. Let o be an affine ring over a ground ring I, let o* 
be an integral, domain which contains o and is a finite o module, and lel p* 
be a prime ideal in o*. Then rankp*—=rank (p*No). 


COROLLARY 2.3. Let (P,M) be a spot over a ground ring I, let P’ bea 
finite P-module, and let p be a prime ideal in P’. Then rankp=rank(p NP). 


3. Analytical unramifiedness of spots which are separably generated 
“ over a ground ring. Statement 1.3 of the introduction will be proven in 
this section (Theorem 3.2). 


THEOREM 3.1. Let (P,M) be a spot over a ground ring C. If the 
quotient field L of P is a finite separable algebraic extension of the quolsent 
field E of C, then P is analytically unramified. 

Proof. (Note that by the dimension formula for the regular local 
ring Cm no ‚ the hypotheses imply rank P £ rank C arno). Since P is aspot - 
over O, P is a spot over C (uno, 80 we may consider C as being a regular local 
ring dominated by P, and rank P rank. Let C’ be the integral closure 
of C in L, and let P’==P[C’]. Since C is a normal Noetherian domain and 
L is separable over E, C” is a finite C module, so P’ is a finite P-module, and 
P is a subspace of P’ ([9], p. 277). Further, P’ is a semi-local domain, so it 
is only necessary to prove that P'a is analytically unramified, where Af’ is a 
maximal ideal of P’ ([9], p. 283). Now rank M’ rank M (Corollary 2.3), 
and 

WNC = (WNP) NAC=MNO, MWN C= (WAC) NC =MNO, 


so rank (W N 0’) N O =rank(M N CO) (Corollary 2.2). Let P” == Py, and 
let D =C wno 80 PZD, rank P” < rank D, and P” is a spot over D 
(since P” is a spot over C). Hence there exist elements e,’ ' ",& in P” 
such that P” is a quotient ring with respect to a prime ideal of the ring 
Die, > *, ex], so by a result of Rees [6] P” is analytically unramified if D 
is. Since C” has only a finite number of maximal ideals and M’ N 0” is one of 
them, it is sufficient to prove that C’ is analytically unramified ([9], p. 283). 
Since L is a finite separable algebraic extension of F, let u be an element 


in © such that L == $, Eut, and set H — ou. Then H is an integral 


domain which alana 6 and is Skin tn C’, hence H is a semi-local 
domain with quotient field L. Let F be the total quotient ring of the com- 
pletion of H. Since C’ is a finite C-module, there exists a nonzero element 
d€@ such that dC’C H. Since the completion of C is a regular local ring 
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([9], p- 302), d is not a zero divisor in this completion of H ([9], p. 27%), 
hence F contains the completion of C’. Let K be the quotient field of the 


completion of C. Then it is seen that F—DiKu‘. Since F is a finite 


‘dimensional algebra over K which contains ie completion of C’ and is con- 
tained in the total quotient ring of the completion of C’, F is the total quotient 
ring of the completion of ©’. It is a straight forward verification that F is 
isomorphic to LOK, and since L is separably generated over Æ, L QK con- 


tains no nonzero silpotant elements ([8], p. 195). Therefore C” is all 
unramified, hence P is analytically unramified, q. e. d. 


THEOREM 3.2. If (P,M) is a spot which is separably generated over a 
ground ring I, then P is analytically unramified. 


Proof. Let. 2,,-,2; be elements in P which form a separating transcen- 
dence base for the quotient field of P over the quotient field of I, and let 
C == I[z,,-,2:]. Then C is a ground ring (if p is a prime ideal in C, then 
I(p N I)is a regular local ring, hence Cy is a regular local ring ([3], p. 404)), 
P is a spot over C, and the quotient field of P is a finite separable algebraic 
extension of the quotient field of C, hence P is analytically unramified 
(Theorem 3.1), q.e.d. 

It is known ([2], p. 414) that if a semi-local domain P is analytically 
unramified, then the derived normal ring of P is a finite P-module, hence 


CoRoLLARY 3.1. If P is a spot which is separably generated over a 
ground ring I, then the derived normal ring of P is a finite P-module. 


COROLLARY 3.2. Let O be a regular local ring with quotient field E, 
and let L be a finite separable extension field of E. Then the integral closure 
C of C in L ts analytically unramified. 


Proof. The completion of C’ is a finite direct sum of analytically 
unramified rings, q.e.d. ` 


COROLLARY 3.3. Let P be a separably generated spot over a ground 
ring I. Then every quadratic transform P’ of P is analytically unramified. 


Proof. P’ is a spot over P and Pisa spot over I, so P” isa separably 
generated spot over I, q.e.d. 


COROLLARY 3.4. Let P be a separably generated spot over a ground 
ring I, let K be a finite separable extension of the quotient field of P, and 


9 


130 LOUIS J. RATLIFF, JR. 


let 21,-,2, be elements in K. Then Pie Tila 28 analytically unr ramified, 
for all prime ideals q in P[ 21, -, 2%]. 


Proof. P[#1,-,%]q is a separably generated spat over I. 

As mentioned in the introduction, Nagata’s proof that a Dedekind domain ` 
has the property (SF) is essentially based on statements 1.1 and 1.2. Since 
Corollary 2.2. and Corollary 3.1 are respectively the generalizations of these 
statements to the case where J is a regular Noetherian domain of finite rank, 
Nagata’s proof carries over verbatim, since the rank of I is finite, to prove 


THEOREM 3.3. If o is an affine ring which is separably generated over 
a ground ring I, then the derived normal ring of o is a finite o-module. 
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EXTENSIONS OF REPRESENTATIONS OF ALGEBRAIC 
LINEAR GROUPS.* * 


By A. BIALYNIOKI-BIRULA, G. HooHsoninp and Q. D. Mostow. 


1. Introduction. Let @ be an algebraic linear group over an arbitrary 
field F. If p is a rational representation of G by linear automorphisms of a 
finite-dimensional F-space U we refer to this structure (U,p) by saying that 
U is a finite-dimensional rational G-module. A G-module that is a sum 
(not necessarily direct) of finite-dimensional rational G-modules is called a 
rational G-module. Let K be an algebraic subgroup of G. .We are interested ` 
in determining when every finite-dimensional rational representation of K 
can be extended to a rational representation of G, i.e., when every finite- 
dimensional rational K-module can be imbedded as a K-submodule in a 
rational G-module. In the. analogous situation for Lie groups, an analysis 
of the the obstructions to the extendibility of representations of a subgroup 
has been made only for normal subgroups, [5], [7], and not much is known 
in the general case. The algebraic case turns out to be much more accessible. 
In particular we shall show, with a very simple argument, that the ertendt- 
bility of arbitrary finite-dimenstonal representations ts already implied by the 
extendibility of the 1-dimensional representations. From this, we shall obtain 
a variety of other sufficient conditions, the simplest of which amounts to the 
result that if K is a normal algebraic subgroup of G then every finite-dimen- 
sional rational representation of K can be extended to one of G. If the base 
field is algebraically closed, we shall see that the extendibility of representations 
of a subgroup K of G ts Rent to the condition that the algebraic variety 
G/K be quast-affine. 

One may also ask the dual a is every finite-dimensional rational 
K-module a K-homomorphic image of a finite-dimensional rational G-module? 
By considering the dual representations, this is immediately seen to be 


equivalent to the extension question, so that our results imply the BE 
dual results. 


2. Representative functions and reduction to rational characters. We 
begin by recalling some elementary notions and results of representation 


* Received December 18, 1962. 
1 Research done under NSF Grant G-24943. 


131 


132 A. BIALYNICKI-BIRULA, G. HOCHSCHILD AND G. D. MOSTOW. 


theory. The rational representative functions on the algebraic group G are 
the composites ¢°p, where p is a finite-dimensional rational representation of 
G and & is a linear functional on the space of all linear endomorphisms of 
the representation space of p. These functions ¢°p are called the repre- 
sentative functions associated with the representation p. We denote the 
space of all these by R(p). The group @ operates by left and right trans- 
lations on R(p). IE fER(p) and ze G, the left translate z- f is defined by 
(x: f)(y) =f (yz), and the right translate f: x is defined by (f-2)(y) = f (zy). 
The totality of all representative functions on @ constitute an algebra R(@) 
over the basic field F. R(@) is a rational G-module, with @ operating either 
by left translations or by right translations. 


If G is given concretely as an algebraic subgroup of the full linear group 
on a finite-dimensional F-space V, and if p is the identity representation of 
G, then R(G) is generated, as an F-algebra, by the elements of R(p), the 
constant 1, and the reciprocal of the determinant function [6, Lemma 10.1]. 
It is immediately seen from this that, if K is an algebratc subgroup of G, 
the restriction map R(G)—> R(E) is surjective. . 

Let p be a finite-dimensional rational representation of the algebraic 
subgroup K of G. It is an elementary fact [6, Prop. 2,3] that the rational 
K-module determined by p may be identified with a K-submodule of a direct 
sum of a finite number of copies of the rational K-module R(p) (on which 
K acts by left translations). Using that the restriction map R(G) > R(E) 
is surjective, we see from this that the representation space W of p may be 
written as U/V, where U is a finite-dimensional rational K-module that is 
contained as a K-submodule in a finite-dimensional rational G-module M, 
and where V is a K-submodule of U. 

Let n be the dimension of V, and consider en ), the homogeneous 
component of degree n-++1 of the exterior F-algebra built over M. This 
contains U A Er(V) asa K-submodule. Clearly, U A £*(V) is K-isomorphic 
with the tensor product W®H*(V) of the rational K-module W by the 
1-dimensional rational K-module #*(V). Now let S be the 1-dimensional 
rational K-module whose character is the reciprocal of the character belonging 
to H*(V). Then W is K-isomorphic with (U A Er(V))®8. Hence, if 8 
is contained as a K-submodule in a rational G-module, so is W. Thus we 
have the following result. 


TEROREM 1. Let G be an algebraic linear group, and let K be an 
algebraic subgroup of G. Suppose that, for every 1-dimensional rational K- 
module that is contained as a K-submodule in a rational G-module, the dual 
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K-module is also a K-submodule of a rational G-module. Then every finite- 
dimensional rational K-module ts a K-submodule of a finite-dimensional 
rational G-module. l 


Since a unipotent algebraic group has no non-trival 1-dimensional 
rational representations, we have the following corollary. 


COROLLARY 1. Let K be a unipotent algebraic subgroup of the algebraic 
linear group G. Then every finite-dimensional rational K-module is a K- 
submodule of a finite-dimenstonal rational G-module. 


3. Application in the case of characteristic 0. Let us assume that the 
basic field F is of characteristic 0. Let @ be an algebraic linear group over F, 
and let K be an algebraic subgroup of G. We denote by Nx the maximum 
unipotent normal subgroup of K. Then, if Sg is any maximal fully reducible 
subgroup of K, we have a semidirect decomposition K = Sx-Nx [8, Theorems 
6.1 and 7.1]. This decomposition is rational, in the following sense. R(K) 
is isomorphic with the tensor product R(Sx)®R(Nx) by the map asso- 
ciating with f@g, where fE R(Sx) and gE R(Nx), the function A on K 
given by h(zy) =f(z)g(y), for all v€ Sx and all yE Nx [4, Section 3]. The 
use we shall make of this decomposition is based on the well known fact that, 
over a field of characteristic 0, every rational module for a fully reducible 
algebraic linear group is semisimple. 


THEOREM 2. Let G be an algebraic linear group over a field of charac- 
teristic 0. Let K be an algebraic subgroup of G, and let Nx, Na denote the 
maximum unipotent normal subgroups of K, G, respectively. Let U be the 
smallest normal algebraic subgroup of G containing Nx. Then each of the 
following three conditions is suficient for every finite-dimensional rational 
K-module to be a K-submodule of a finite-dimenstonal rational G-module. 
(1): Ne C Na; (2): K ts normal in G; (3): U N E == Ng, and the base 
field is algebraically closed. 


Proof. In case (1), we make a semidirect product decomposition 
K=Sx-Nx, as described above, and we let Sg denote a maximal fully 
reducible subgroup of @ containing Sx, so that G==Sq:Ng. Now let p be 
a i-dimensional rational representation of K. Consider the restriction of p 
to Sg. Its representation space may be written as A/B, where A is a finite- 
dimensional rational Sx-module that is contained as an Sx-submodule in a 
finite-dimensional rational Sg-module, and where B is an Sg-submodule of A. 
Since the basic field is of characteristic 0 and Sx is fully reducible, A is semi- 
simple as an Sx-module, so that A/B is isomorphic with an Sx-submodule of 
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A. Thus we conclude that the restriction of p to Sg can be extended to a 
finite-dimensional rational representation o of Sg. We may regard o as a 
rational representation + of @ whose kernel contains Ng. Since Ng C No 
and Nx lies in the kernel of p, it is clear that + is an extension of p. By 
Theorem 1, this implies that every finite-dimensional rational K-module is 
a K-submodule of a finite-dimensional rational G-module. 

In case (2), we note that Nx is also normal in G, whence Nx C No, 
so that the conclusion follows from case (1). 

Now suppose that condition (3) is satisfied. By [3, Prop. 11, p. 119], 
there is a finite-dimensional rational representation p of @ whose kernel is 
precisely U. Since the base field is algebraically closed, p(G') is an algebraic 
linear group, and p(X) is an algebraic subgroup of p(G). Since U N K = Nr, 
the restriction of p to Sx is a bijection of Sx onto p(K). Since the base field 
is algebraically closed and of characteristic 0, the inverse r: p(K)— Sx of 
the restriction of p to Sx is also rational [6, Lemma 10.2]. 

Now let o be a 1-dimensional rational representation of K. Then o 
must be trivial on Vx, and cor is a rational representation of p(K). Since 
p(K) =p(Sx), it is fully reducible. Hence, by case (1) above, vor extends 
to a finite-dimensional rational representation y of p(@). Now yop is a 
rational representation of G that extends the given representation o of K. 
This completes the proof of Theorem 2. 


4, Algebraic-geometric structure. Let us say that an algebraic sub-_ 
group K of an algebraic linear group @ is an observable subgroup if every 
finite-dimensional rational K-module is a K-submodule of a finite-dimensional 
rational G-module. We make a few notational conventions, as follows. 

Q(G) will denote the field of all rational functions on G; this is the 
field of quotients of R(@). For any G-module M, MC wil denote the sub- 
space of Af consisting of all G-fixed elements. We shall regard R(G) and 
Q(G@) as K-modules with K operating by left translations, where K is a 
subgroup of @. 


THEOREM 3. Let G be an irreducible algebraic linear group over an 
arbitrary field, and let K be an algebratc subgroup of G. Then K ts an observ- 
able subgroup of G if and only tf Q(G)* coincides with the field of quotients 
of R(G)E. 


Proof. Suppose first that K is an observable subgroup of G. Let q be a 
non-zero element of (G@)*. It suffices to show that (R(@)q N R(G))* (0). 
Let V be any non-zero simple K-submodule of R(@)qN R(G), and let V* 
be the dual K-module. By assumption, V* is a K-submodule of a finite- 


ALGEBRAIO LINEAR GROUPS. ` 185 


dimensional rational G-module W. Since W is isomorphic with a G-sub- 
module of a direct sum of a finite number of copies of R(@), and since y* 
is simple, it follows that there exists a K-module monomorphism ¢ of V* 
into R(G). Let (v, °°, vn) be a basis’of V such that »,(1) 40 and 
v,(1) 0, for each +>1. Let (a:,---,@,) be the dual basis of V*, and 


put g—o(a). Then Y (grejne (B(G)qA (R(G))X, for every ze @. 
41 


Take x such that g,(z) 540. Then this function is not zero. Thus the 
necessity of the condition is proved. : 

In proving the sufficiency, let us first observe that we may assume that 
the base field F is algebraically closed. For let Æ be an algebraic closure of 
F, and let G’, K’ be the canonical extensions of G, K, respectively, to algebraic 
linear groups over F. We have R(G’) = R(G) r F and Q(@’) = Q(G) Or E 
Since every rational function. vanishing on. K vanishes also on K’, we have 
R(G’)®’ = R(G’)K — R(Q) 8r F’, and similarly Q(G’)* —Q(G)% 8r F 
Hence if Q(G)* is the field of quotients of R(G)* then also Q(G’)*’ is the 
field of quotients of R(@’)*. On the other hand, it is easy fo see that if K’ 
is observable in G” then K is observable in G. In fact, if S is a finite-dimen- 
sional rational K-module, then S is a K-submodule of the rational K’-module 
S@,F’. Now, if $®rF’ is a K’-submodule of a rational G’-module T, we 
may regard T as a G-module over the field F. Since R(G’) <=R(G) 8r F, 
T is then a rational G-module containing § as a K-submodule, which suffices 
for concluding that K is observable in @. ` 

There remains to prove the sufficiency of the condition in the case whee 
F is algebraically closed. In that case, let f be an element of R(G) such 
that f(1) 40 and 2 f=y(z)f, with y(x) € F, for every ze K. For every 
ze G, we have (f-x)/f€ Q(G)E, sò that, by our assumption, there is a non- 
zero element k, in R(G)* such that (F-z)ksE R(G)*f. Let Z be the set of 
zeros of f in G, and let Z” be its complement. Then ke must vanish on 
ZNZ. Since 1€ Z’, yeyZ’, for every y€ G. Hence Z is covered by the 
open sets z'Z’. Hence there is a finite set T: --,2, in G such that Z is 
the union of the sets Z N aZ, Put k == ke’ + -ko Then k is a non-zero 
element of R(@)X that vanishes on Z. By Hilbert’s Nullstellensatz, there is 
therefore a positive integer m such that k” =— gf, with ge R(@). This yields 
x- g—=y(x)-1g, for every v€ K. The existence of a non-zero element geR(@) 
such as we have just found, for every f€ R(@) such as the above, is evidently 
equivalent to the condition of Theorem 1. Hence we may indeed conclude 
that K is an observable subgroup of G. 


THEOREM 4. Let P be an irreducible algebraic nia group over an 
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algebraically closed field F, and let K be an algebraic subgroup of G. Then 
the following conditions are equivalent: 


(1) Kisan observable subgroup of G; 

(2) R(G)¥ separates the points of G/K; 

(3) the field. of quotients of R(G)* coincides with O(G)*; 

(4) the algebraic variety Q/K is quast-affine (i. e., an open subvartety of 
an affine algebraic variety). 

Proof: By Theorem 3, (1) and (3) are equivalent. Since Q (Q) E 
‚separates the points of G/K [1, p. 8], (3) implies (2). 

The rest of the proof requires more elaborate algebraic-geometric tools. 
We recall first that the canonical structure of an algebraic variety of G/K 
satisfies the following (characteristic) conditions. The canonical map 
G—>» G/K is an open morphism whose cohomomorphism maps the field of the 
rational functions on G/K isomorphically onto Q(@)*. If ¢ is any morphism 
of G into an algebraic variety V such that (sy) == (x), for all ze G and 
all y € K, there is a unique morphism y of G/K into V whose composite with 
the canonical morphism G— G/K coincides with & [1, Theorems 1 and 4]. 

Now we show that (4) implies (1). Suppose that G/K is a quasi-afline 
variety, and let f be an element of R(@) such that f(1) 40 ande f=y(z)f, 
for every z€ K, with y(x) € F. Let Z be the set of zeros of fin @. Let p 
denote the canonical map G> G/K. Since ZK = Z, we have Z =p 4(p(Z)). 
Since p is an open map, it follows that p(Z) is closed in G/K. Since 
K¢p(Z) and G/K is quasi-affine, there is an everywhere defined rational 
function « on G/K such that a(K) #0 and a(p(Z)) = (0). Putk=—aop., 
Then ke R(G)E, k(Z)— (0) and k(1) 0. As we have seen in the proof 
of Theorem 3, this implies that K is an observable subgroup of G, i.e., that 
(1) is satisfied. `` i 

Next we show that (2) implies (3). Let T denote the field of quotients. 
of R(G)*%. If (2) is satisfied T separates the points of the algebraic variety 
@/K. It follows that the field Q(@)* of all rational functions on G/K is a 
purely inseparable algebraic extension of 7. This implies that, if J is the 
integral closure of R(G@)* in Q(@)X, T coincides with the field of quotients 
of J. On the other hand, @ is a normal affine algebraic variety, and R(@) 
is the ring of all everywhere defined rational functions on G. Hence R(@) 
is integrally closed in Q(@), whence J C R(G)NQ(G)X == R(G)X, .and 
T==Q(G)*. Thus we have shown that (2) implies (3). 

There remains only to show that (3) implies (4). If (8) is satisfied then, 
since Q(@)X is finitely generated, there is a finitely generated F-subalgebra B 
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of R(G)X such that Q(@)* coincides with the field of quatients of B and 
B is stable under the right translations f—f-2, with re @. Let V denote 
the affine algebraic variety whose points are the specializations of B. Clearly, 
the group @ acts as a group of automorphisms v—>x'v on V, where 
(z:v) (b) ==v(b-x), for every bEB. Let ¢ denote the morphism GV 
defined by $(2) (b) == (x), for every ze G and every bE B. Evidently, ¢ 
is a @-morphism with respect to the action of G by the translations y— ay 
on Gand v—c«-von V. By elementary specialization theory, ¢(@) contains 
an open subset of V, Since @ acts transitively on #(@), it follows that 
(GŒ) is open in F. Thus ¢(@) is a quasi-affine algebraic variety. Since 
(zy) = $ (x), for every ze G and every y€ K, p induces a unique morphism 
y: G/K—¢(G) such that pyop=—=¢, where p is the canonical morphism 
G—>G/K. Evidently, y is still a G-morphism with respect to the action of 
G on G/K and on $(@), and y is bijective. Since the field of quotients of 
B coincides with Q(@)* and since #(@) is open in Y, the cohomorphism of y 
is an isomorphism of the field of rational functions on #(@) onto the field 
of the rational functions on G/K. Hence there is a rational map p from 
$(G) to G/K such yop and pow are the identity maps on ¢(@) and G/K, 
respectively. Since y is bijective, this means that the set-theoretical inverse 
y of w coincides with a morphism on some open subvariety of #(G@). Since 
y is a G-morphism, it is clear that if y™ coincides with a morphism on an 
open subvariety D of ¢(G@) then y™ coincides with a morphism also on s: D, 
for every tE @. Since @ acts transitively on $(G@), it follows that y* is 
actually a morphism of #(@) onto G/K. Thus y is an isomorphism, and we 
have shown G/K is quasi-affine. This completes the proof of Theorem 4. 


5. Applications. Since, in the last section, we have assumed that the 
basic field is algebraically closed and @ irreducible, we begin with two elemen- 
tary results of reduction to this case. 


THEOREM 5. Let G be an algebraic linear group over an arbitrary field 
F, and let K be an algebraic subgroup of G. Let F be an algebraic extension 
field of F, and let @’, K denote the canonical extensions of G, K to algebraic 
linear groups over F. Then K’ is observable in @ if and only if K is 
observable in G. 


Proof. The proof is contained in our proof of Theorem 3 above. 


THEOREM 6. Let G be an algebraic linear group over an arbitrary field F, 
let G, be the irreducible component of the identity in G, and let K be an 
algebraic subgroup of G. Then K is observable in G tf and only if KNG, is 
observable in Gy. 


138 A. BIALYNICKI-BIRULA, G. HOCHSCHILD AND G. D. MOSTOW. . 


Proof. For any group U, let F[U] denote the group algebra of U over 


F, and regard any U-module over F as an F[U]-module in the usual fashion. `- 


Suppose first that K is observable in G, and let W be a finite-dimensional~ 
rational (K N G,)-module. Form the tensor product F[K] @rx ned W, and 
let K operate on it by multiplication from the left on the factor F[K]. Since 
K/(K N Gy) is finite, it is clear that F[K] Orna W is a finite-dimensional 
rational K-module containing W as a (K N G,)-submodule in the natural 
fashion. Since K is observable in G, this rational K-module is a K-sub- . 
module of a finite-dimensional rational @-module T, say. We may regard T 
as a rational G,-module, and wi isa (K N G,)-submodule of a Thus K N G, 
is observable in G. ; 
Now suppose that K N G, is observable in G, Pe let S be a finite- 
dimensional rational K-module. Then there is a’ (K N G,)-module mono- 
morphism ¢ of S into a finite-dimensional rational G;-module P. As above, . 
we form the finite-dimensional rational G-module FL] Spa, P. Let 
1," ',Tm be a system of representatives in K for the elements of K C/G 


Define the linear map y of 8 into F[@] 8ra P by y(s) - nos =. -8) a 


Since ¢ is a (K N @,)-module homomorphism, it is clear that y is actually 
independent of the particular choice of the representatives 2, Using this, 
one sees immediately that y is a K-module homomorphism. Moreover, it is 
clear that y is injective. Thus y is a K-module imbedding of S in a-finite- 
dimensional rational G-module, and we have shown’ that K is observable in G. 
This completes the proof of Theorem 6. i 


THEOREM 7. Let G be an algebraic linear group over an arbitrary field, 
let K be an algebraic subgroup of G, and let L be a normal algebraic. subgroup 
of K. Suppose that L is observable in G and that either K/L is ‘finite or. 
every rational representation of K that is trivial on L is unipotent. Then K` 
is observable in G. Pe 


Proof. By Theorem 6, it suffices to show that K N G is observable in G.. 
Now LN G, is a normal algebraic subgroup of K N G, and is observable in Gh, 
by Theorem 6. If K/L is finite, so is (ENG,)/(LNG,). A rational © 
representation of K N G, that is trivial on LN G, may be regarded. as a 
rational representation of L(K N @,) that is trivial on Z. The: induced 
representation of K, constructed as in the proof of Theorem 6, is then trivial 
on L. Hence, if every rational representation of K that is trivial on L is 
unipotent, then also every rational representation of KN G, that.is trivial 
on LN G is unipotent. Henes we may now suppose that @ is irreducible. l 


ALGEBRAIO LINEAR GROUPS. 139 


In that case, we see from Theorem 3 that it suffices to show that Q(G)* 
coincides with the field of quotients of R(G)*. Since L is observable in G, 
we know from Theorem 3 that Q(G@)” coincides with the field of quotients 
of R(Q)”. Now let q be a non-zero element of Q(G@)*. Then, since q lies 
in the field of quotients of R(@)L, we have R(G)4¥aN R(G)2 (0). This 
space is a rational K-module, with K operating by left translation, and L acts 
trivially. Hence, if every rational representation of K that is trivial on L is 
unipotent, there is a non-zero K-fixed element in R(G)?qN R(@)?, which 
means that g lies in the field of quotients of R(@)X. On the other hand, if 
K/L is finite, write g==f/g, with f and g in R(@)?”. Let g* denote the 
product of the translates z-g, where z ranges over a complete system of 
representatives in K for the cosets of Lin K. Then g* € R(G)E, and we may 
write ggg’, with g € R(G)". Now we have q= (fg’)/g* and, since q 
and g* lie in Q(@)*, it follows that fg’¢ R(G@)*, so that again q lies in the 
field of quotients of R(@)X. This completes the proof of Theorem 7. 


COROLLARY 2. Let G be an algebraic linear group over an arbitrary 
field, and let K be an algebraic subgroup of G such that K, ts nilpotent. 
Then K is observable in G. 


Proof. Theorem 7, with L == K,, shows that it suffices to prove that Ky 
is observable in G. By Theorem 5, we may assume that the base field is 
algebraically closed. By a well known result due to A. Borel, K, is then a 
direct product LX U, where L is central and consists of the semisimple 
elements of K,, and U is the maximum unipotent normal subgroup of K.. 
Since every rational representation of L is semisimple, it follows, as in the 
first part of the proof of Theorem 2, that L is observable in G. Since U is 
unipotent, every rational representation of K, that is trivial on L is unipotent. 
Hence we may conclude from Theorem 7 that K, is observable in G, q.e.d. 


The implication (1) —> (4) of Theorem 4, together with Corollary 2 and 
the case L= K, of Theorem 7, generalize a result of M. Rosenlicht [9, Th. 3]. 

The following is essentially a reformulation of parts of Theorems 3 
and 4. 


THEOREM 8. Let G be an algebratc linear group over the field F, and 
let K be an algebraic subgroup of G. Then, if K is observable in G, K is 
the isotropy subgroup of an element of a rational G-module. Conversely, 
if F is algebraically closed and K is the isotropy subgroup of an element of a 
rational G-module then K is observable in G. 


Proof. Suppose that K is observable in G. By Theorem 6, K N G, is 
then observable in G,. Since Q(G,)*%% is finitely generated and separates 
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the elements of G./(KMG,), it is clear from Theorem 3 that there is a 
finite set fi," * ',fa of elements of R(G,)¥°% separating K N G, from all 
the other cosets of K N G, in G,. Let V, be the rational G,-module spanned 
by the left translates of f, and let V be the direct sum of the V/s. Then, with 

v=(fi,°- fs) € V, K N G is clearly the isotropy subgroup of v. Now let 
W—F[@G] 8ra V, and let 2,:--,2¢ be a complete system of represen- 
tatives in K for the cosets of KN G,. Put 


w=S2@ve W. 
E 


Clearly, £: w==w, for every ze K. Conversely, if s€ G and z:w= w, we 
note first that no two of the elements Tt,’ - *, 2&4 can lie in the same coset 
of G, in @ and hence conclude that 22,€ KG, for each i. Thus we have 
2, = ty2(i), with z(i) € G,, where ii’ is a permutation of the set (1,- - -, q). 
Furthermore, we see that we must have z(t)-:v—=v, so that c(t) € KM G, 
whence ze K. Thus K is precisely the isotropy subgroup of w, and the first 
part of Theorem 8 is proved. 

Now suppose that F is algebraically closed, that V is a rational G-module, 
and that K is the isotropy subgroup of an element ve V. For every linear 
functional & on V, denote by ¢/v the function on G defined by (#/v) (2) 
—=¢(x-v). Then each ¢/v is an element of R(@)X, and the set of all these 
functions, as ¢ ranges over the space of the linear functionals on V, separates 
the elements of G/K. Thus R(G@)* separates the elements of G/K. A. 
fortiori, R(G,)*9% separates the elements of G,/(K N G1). Hence we con- 
clude from Theorem 4 that K N G, is observable in G,. By Theorem 6, it 
follows that K is observable in G, and Theorem 8 is proved. 

The criterion of Theorem 8 is convenient in proving the following 
stronger form of Theorem 7. The reason for exhibiting Theorem 7 separately 
is that its proof is elemeritary, while our proof of Theorem 9 below finally 
appeals to Theorem 4 and thus rests on the consideration of homogeneous 
spaces as algebraic varieties. 


THEOREM 9. Let G be an algebraic linear group over an arbitrary field 
F, K an algebraic subgroup of G, L a normal algebraic subgroup of K. 
Suppose that L is observable in G and that, for every 1-dimenstonal rational 
representation p of K that ts trivial on L and extendible to a rational repre- 
sentation of G, some tensor power of the dual of p can be extended to a rational 
representation of G. Then K is observable in @. l 


Proof. We shall show in an elementary way that the assumptions of the 
theorem imply that K is the isotropy subgroup of an element of a rational 
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G-module. However, in order to be in position to appeal to Theorem 8 for 
the conclusion that K is observable in G, we must have F algebraically closed. 
Therefore, we begin by showing that our assumptions remain satisfied when 
the base field is extended to its algebraic closure. 


Let F” be an algebraic closure of F, and let G’, K’, L’ denote the canonical 
extensions of G, K, L, respectively, to algebraic linear groups over F”. Then 
I’ is normal in K’, and, by Theorem 5, L’ is observable in G’. Let y be a 
rational character of K’ that is trivial on Z’ and whose associated 1-dimensional 
K’-module is a K’-submodule of a rational G’-module. We must show that 
the same is true for the 1-dimensional K’-module associated with some positive 
integral power of the reciprocal of y. 

Let « be any F-automorphism of F’. Then a induces F-automorphisms 
fof* of R(G’) =R(G) Or F and of R(K’) = R(K) 8r F” in the natural 
fashion, and these are compatible with the restriction map from @ to K’. 
Now y“ is an element of R(K’) whose restriction to K is a homomorphism 
into the multiplicative group of F’ and whose restriction to L is trivial. It 
follows that y% is a rational character of K’ that is trivial on L’. Moreover, 
it is easy to see that the 1-dimensional K’-module associated with y% is a 
K’-submodule of a rational G’-module, from the fact that this is true for y. 

Since the restriction of y to K takes its values in some finite algebraic 
extension of F, we can find a finite number of F-automorphisms ai, - -, a 
of F” such that the restriction to K of the product yy": - y“ takes its values 
in a finite purely inseparable algebraic extension of F. Hence the restriction 
to K of some positive integral power of this product is a rational character y 
of K that is trivial on Z and whose associated 1-dimensional K-module is a 
K-submodule of a rational G-module. 

By the assumption of our theorem, there is a positive integer q such that 
the 1-dimensional K-module associated with the character (y-*)¢ is a K-sub- 
module of a rational G-module. On the other hand, some positive integral 
power of (yy%- - -y%!)+ is the canonical extension to K’ of (y-*)%, whence 
its associated K’-module is a K’-submodule of a rational G’-module. Writing 


(y5) = (Cry iD a) La (yt sy) 


and noting that each y% has the requisite extendibility property, we see that, 
for some positive integer r, the 1-dimensional K’-module associated with 
(y*)" is a K’-submodule of a rational G’-module. 

Thus (@,K’,L’) satisfies the conditions of our theorem. Once the 
theorem is proved for the case of an algebraically closed base field, we con- 
clude that K’ is observable in G’, and this implies, by Theorem 5, that K is 
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observable in G. Thus we may now assume that F is algebraically closed, 
“but this will be used only at the very end, when we appeal to Theorem 8. 

Since L is observable in G, we know from the first part of Theorem 8 
that it is the isotropy subgroup of an element of a rational G-module. As we 
have seen in proving the second part of Theorem 8, this implies that R(@)? 
separates the elements of G/Z. It is easily seen from this that there is a 
finite-dimensional left K-stable subspace U of R(@)? such that the restriction 
to K of every element of U is 0 and such that every zero of U lies in K. -Let 
V be the smallest left G-stable subspace of R(@) containing U, and let n be 
` the dimension of U. Consider Er(V), the homogeneous component of degree 
n of the exterior algebra built over V. This is a rational G-module containing 
Er(U) as a 1-dimensional K-submodule. Clearly, L operates trivially on 
E(U). If 2€G@ and z- Er(U)C E*(U) it follows easily that 2-U CU, 
whence « is a zero of U and so ze K. In fact, we have actually z- #*(U) 
== Er (U), whence x: Er(U) = Er(U), so that we obtain, working in #"**(V), 

(z: U) A E(U) =z: (U A s>: E*(U)) =x: (U A E*(U)) = (0), 
which shows that z: U C U. 


Now apply the assumption of the theorem to the PE EAA po K 
on Er(U). Let W be a rational G-module containing the g-th tensor power, 


p _ X, of the dual of p as a K-submodule. With Ta denoting q-th tensor power, 


consider the rational G-module G=—_T«(H*(V))@W. This contains the 
trivial 1-dimensional K-module Te(Er(U))®X as a K-submodule. If z is 
an element of G leaving this submodule fixed we must have x: Er(U)C Er(U), 
so that ze K. Thus K is the isotropy subgroup of a basis element of 
Te(Er(U))®X in the rational G-module S. By Theorem 8, K is therefore 
observable in @, which completes the proof of Theorem 9. 


TEEOREM 10. Let G be an algebraic linear group over an arbitrary field 
F, and let K be a normal algebraic subgroup of G. Then K is observable 
in G: 

Proof. By Theorems 5 and 6, we may assume without loss of generality 
that F is algebraically closed and that @ is irreducible. Since K is normal 
in G, there is a finite-dimensional rational representation of G whose kernel 


is exactly K [3, Prop. 11, p. 119]. Hence condition (2) of Theorem 4 is 
_ satisfied, so that K is observable in G. 


THrorem 11. Let G be an algebraic linear group over an infinite 


perfect field. Then, if K and L are observable algebraic subgroups of G, so 
s KNAL 


Proof. First, suppose that the base field is algebraically closed. By 
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Theorem 6, we may assume that @ is irreducible.’ Clearly, if K and L satisfy 
condition (2) of Theorem 4, so does K N L, whence the result. 

Now assume only that the base field F is infinite and perfect. Let F” be 
an algebraic closure of F. For any algebraic linear group U over F, let U’ 
denote its canonical extension to an algebraic linear group over Æ. By 
Theorem 5, K’ and I” are observable in G’. By what we have just proved, 
K’ N I is therefore observable in G’. Evidently (or by Theorem 6), (K N L’), 
is observable in K’ LZ’. Hence (K’NL/), is observable also in G’. Now 
K’ N I’ is defined over the subfield F of F”, from which it follows easily that 
(K’ 1 L’) is also defined over F. By a result due to M. Rosenlicht [10. p. 44, 
Corollary], this and the fact that F is an infinite perfect field imply that the 
set of points of (K’ ML’), that are rational over F is dense in (K'A L’);. 
Since these points lie in K N L, we have therefore (K’N LT’), C (KALY, 
whence (K'A L’),== ((KNL)’),. Thus we conclude that ((K NLY), is 
observable in G. By Theorem 7, this implies that (K ML)’ is observable 
in G’, Finally, Theorem 5 now gives that KML is observable in G, and 
our proof of Theorem 11 is complete. 


There are some immediate algebraic-geometric consequences of our results 
that are worthy of note. Let G be an irreducible algebraic linar group over 
an algebraically closed field, and let K and L be algebraic subgroups of G 
such that G/K and G/L are quasi-afine. Then G/(K OL) is quasi-affine. 
Also, tf K and L are algebraic subgroups of G such that K CL, and G/L 
and L/K are quasi-affine, then G/K is quast-affine. Indeed, in the first case, 
K and L are observable in G, by Theorem 4. Hence, by Theorem 11, KN L 
is observable in G. By Theorem 4, G/(K N L) is therefore quasi-affine. In 
the second case, we conclude from Theorem 4 that K is observable in Z and 
that L is observable in G. This implies quite evidently that K is observable 
in G, so that, by Theorem 4, @/K is quasi-affine. 


6. Some illustrative examples. There is a simple example, pointed 
out by Rosenlicht [3, p. 223], showing that G/K may be quasi-affine without 
being affine. Let F be an algebraically closed field, G—=SL(2,F), K the 


7 oe Then the algebraic variety 


@/K is isomorphic with the variety resulting from F X F when the point 
(0,0) is removed. 
Let G==@L(2,F), and let K be the algebraic subgroup consisting of 


subgroup of all matrices of the form ( 


all matrices of the form K a) a0. It is not difficult to verify directly 
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that the condition of Theorem 1 is satisfied by (G, K), so that K is observ- 
able in G. On the other hand, (G,K) satisfies none of the intrinsic group- 
theoretical sufficient conditions of Theorem 2. Let Z be the algebraic sub- 


group of G consisting of all matrices of the form & A a20. Then L 


is also observable in G. Let U be the group generated by K and L. Then U 
is actually the direct product K X L and consists of all non-singular triangular 
matrices. The algebraic variety G/U is complete (it is the well-known flag 
manifold), and thus is certainly not quasi-affine. Hence U is not observable 
in G, although it is the direct product of two observable subgroups. 

More generally, let @=GL(n,F), with F algebraically closed, and let 
K be the unipotent algebraic subgroup of all triangular matrices with 1’s on 
the diagonal. Let L be the algebraic subgroup of G consisting of all diagonal 
matrices. Then K and L are both observable in G. On the other hand, the 
group U generated by K and L is a semidirect product K- L, and consists of 
all non-singular triangular matrices. Since G/U is complete, U is not observ- 
able in G. 
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ON RADICALS OF DISCRETE SUBGROUPS OF LIE GROUPS.* 


By Lovis AUSLANDER.! 


1. Introduction. Zassenhaus [1] showed that subgroups H of the 
general linear group GL(n,R) possess unique maximal normal solvable sub- 
groups. (For a recent account of this result see [2].) He called the maximal 
normal solvable subgroup of H the radical of H. For our purpose it will be 
more convenient to call these subgroups discrete radicals. We will denote 
the discrete radical of H by r(H). We will call a connected Lie group an 
analytic group. Let @ be an analytic group and let H be a subgroup of G. 
Then since G has a matrix representation with the kernel of the representing 
homomorphism in the center of G, it follows that any subgroup H of G has a 
discrete radical, r(H). 
© Now, in addition to the discrete radical of a group H, one may consider 
the more refined concept of the discrete nil-radical of H. By this we will 
mean the maximal normal nilpotent subgroup of H. From standard con- 
siderations of algebraic groups, it is easy to show that any subgroup H 
of an analytic group @ has a discrete nil-radical, denoted by n—1(#H). 
Zassenhaus further stated a theorem which gives conditions under which 
r(H), H C @L(n, R), is non-trivial. Unfortunately, the proof Zassenhaus 
gave his assertion is in error. (Zassenhaus has assured the author that his 
method of proof can be corrected to give a valid proof of his theorem.) ‘The 
Zassenhaus result may be stated as follows: 


ZASSENHAUS LEMMA. Let G be an analytic group and.let A be a closed, 
normal, simply connected abelian analytic sumbroup of G. Let T be a 
discrete subgroup of G. If the image of in G/A is not discrete, then (D) 
ts non-trivial. To be more precise, I’s intersection with the identity com- 
ponent of the closure of the group TA is in r(T). 


It will be our purpose in this paper to give a new proof of the Zassen- 
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haus lemma and outline its central position in unifying certain studies con- 
cerning subgroups of Lie groups with compact quotient. 


' 2. Zassenhaus lemma. We will now state the lemma in a slightly 
more convenient, but equivalent form to that in the introduction. For 
notational convenience we will use /( ) to denote the eee component 
of the closure of the group in the bracket. 


ZASSENHAUS Lemma. Let G be a Lie group and let A be a closed, 
normal vector subgroup of G. Further let T be a discrete subgroup of G. 
Then I(TA) is solvable and hence TNI(TA)Cr(T). 


Proof. If I(TA)—=4, then the lemma is trivially true. Let K 
be I(TA)/A, dim.K>0. For any elements a and b in a group, we will 
let (a,b) denote the commutator aba*b. Let U, be an open set in K such 
that, for kı k€ Un (kı,ks)E Ur. If we choose a basis in A and let 
ad(k) <=yAy*, where y is any pre-image of k, we may also require that for 
every k € U, every entry in the matrix (ad(k) —I) shall have absolute value 
less than 10+, where I is the identity matrix. We. will denote the fact 
that every entry in the matrix (ad(k) —I) has absolute value less than 
10” by |ad(k)—I| <10". Let U CU, be such that if kı k€ U and 
| ad(k,) —I|<107, |ad(k,) —I!|<10* then |ad((k,,k)) —I| <10, 
where t= max. (r,s) +1 and r>0,s>0. The existence of the neighbor- 
hood U follows from Lemma 3.1 in [6]. 

For any kE (I(TA) NTA/A) OU, let yer bea pre-image of k. Then 
y= zy, where y€ A and zE U*, where U* is a neighborhood of the identity 
in @ whose closure is compact and which maps onto U by the natural pro- 
jection. We may require that U* have the further property that if u,,u,€ U* 
(t, U2) € U*. Since T is a discrete subgroup of H, there exists a d,>0 
such that |y| > d, relative to the euclidean norm determined by the fixed 
basis already chosen in A. Then 


ur) = (2, made) ade) —Dys + E A 


where y= ays, i= 1,2, ad(2) =ad(k;), k€ (I(TA) NTA/A) OU. Now 
since /(TA)/A is an analytic group, it is generated by any neighborhood of 
the identity and hence by the closure of the group generated by any dense 
subset of elements of T such that y= BY, wE UŽ, yE A, i=l, r We 
will show that the group generated by the set yı’ * *,yr is nilpotent. This 
amounts to showing that any collection of k>0 elements from y,° ' Yr 
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combined by commutators in any order is zero. But this follows easily 
from the previous ‘discussion. For, if max.|y;|==D; choose & such that 
10*D < d,/2. 

This proves that the group generated by any finite collection of elements 
in U* is nilpotent. Hence, a group with the same Lie algebra as I(TA)/A 
in some matrix representation is solvable. We can then conclude that /(TA) 
is solvable. 2 


Proposition 2. Let G be a Lie group, contain R as a closed normal 
solvable subgroup, and let R be connected and simply connected. - Further let 
T be a discrete subgroup of G. Then I(TR) is solvable. 


Proof. We will prove the theorem by N on the number of steps 
of solvability of R. If R is abelian,.we have proven the proposition in the 
. Zassenhaus lemma. Assume the assertion is false. The there exist arbi- 
trarily close to the identity in /(TR)/R finite sets of elements in I(TR)NTR/R ` 
which do not generate nilpotent groups: Now arguing as in the Zassenhaus, 
lemma, we must have that the mage of Tin G/[R, R] is not discrete. Let 


Ben, TRUE Be 


where e is the identity element of G. Then it is easy to see that the image 
‘of T in Q/R, is not discrete for any s and hence the image of T in G is not 
discrete. This contradicts the definition of and proves our assertion. 


8. Discrete radicals: We will adopt the following conventions: Let @ 
be a simply connected analytic group and let the Levi decomposition of 
- G=R-8, where R is the radical of G” (i.e. the maximal analytic normal 
solvable subgroup) ; $ is a semi-simple analytic group; and, the dot denotes 
the semi-direct product. Now’ S is the direct product of simple analytic 
groups &;,t—=1,---,%. We will call the 8; the simple components of 5S. 
We will further use C, to denote the direct product of all the compact com- 
ponents of S and call C the compact part of 8. Clearly the group R-C is 
unique and independent of the semi-direct product used in its definition. In 
addition to the radical of G, we will need the more refined notion of the nil- 
radical of G, By the nil-radical, we mean the maximal normal nilpotent 
analytic subgroup of G. From standard considerations, ‘it is easly to see that 
any subgroup H of an analytic group G has a maximal nilpotent normal sub- 
group called the discrete nil-radical and denoted by n—r(H). 
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PROPOSITION 3. Let G be a simply connected analytic group with Levi ` 
decomposition G==R-S; let T be a discrete subgroup of G with compact 
quotient; and let C be the compact part of S. Then I(TR)/R is abelian and 
contained in C. 


This Proposition follows easily trom the Zassenhaus lemma and work 
of Borel [7]. 


TuxoreM 1. Let G be a simply connected analytic group with Levt 
decomposition G==R-S and let C be the compact part of 8. If T ts a` 
discrete subgroup of G such that G/T is compact, then we have the following: 


1. TNER-(C has compact quotient in R-C. 
2. TYTNER-C is a discrete subgroup with compact quotient in s/c. 


3. r(@)O/r(@)ONT has a finite number of ER and its identity - 
component is compact. 


Proof. The proof of 1 and 2 of this theorem is equivalent to the proof 
that I(T RC) = RC. But this follows easily from Proposition 3 and the fact 
that C is compact. Hence all that remains is to prove 3. .. 

Note first that the identity component of r(@) =R and hence by 2 
above if D= (r(@)/RC) N (8/0): our assertion amounts to verifying that 
(T/T N RO) N D is of finite index in D. Hence we lose no generality in 
considering just the following case: Let S be a connected, simply connected, 
semi-simple Lie group with no compact component and let T be a discrete 
subgroup of S such that S/T is compact. Let D be the discrete radical of 5S 
and let C C D be the center of 9. We first note that C is of finite index in D. 


For let S/C*, C* C C have a faithful’ matrix representation. Then D/C* - - 


is a normal solvable subgroup of a semi-simple matrix group. Then arguing 
as in Proposition 3, we see that L/C* is finite and hence D/C is finite. We 
will now see that TMC is of finite index. Assume this.statement is false: 
Then C cannot be a finite group and further the group TC cannot be discrete 
as both S/T and $/TC are compact and one is an infinite covering of the 
other. Then J(TC) is non-trivial and there exist yı, ya € T such that y; == 24, 
t=>1,2, where 2; are arbitrarily close to the identity in Sand q€C. Hence 
(Yu Y2) = (21,22) is arbitrarily close to the identity and since T is discrete 
it must be the identity. Hence /(TC) is an abelian analytic group. Hence 
in §/C* the image I* of I(TC') must be an analytic abelian group with the 

property that y*I*y**—J* for all y¥eTc*/O*. But this is impossible. 
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Hence T N € is of finite index in C and since is of finite index in D, TAD 
must be of finite index in D. This proves our assertion. 


COROLLARY. Let G be a simply connected analytic group and let T be 
a discrete subgroup of G with compact quotient. Then G/T is a fiber bundle 
over a space X with fiber Y, where 


Y—R-O/TAR-C and X= (8/0)/ (T/E N R-0). 


Remark. It would be worthwhile’ determining whether this bundle .can 
ever be non-trivial and, if so, the structure of the group @ in these cases. 


4, Further applications. Zassenhaus related his result to the classical 
theorem of L. Bieberbach [3] on space groups, which in modern language 
may be restated as follows: 


‘BrepersaoH THEOREM. Let T be a discrete subgroup of the group of 
rigid motions R(n) of Euclidean n-dimensional space such that R(n)/T ts 
compact. Let T denote the subgroup of R(n) consisting of pure translations. 
Then the identity component of the closure of the group TT is T. 


Now the already mentioned Bieberbach theorem is a refinement of 
Theorem 1 in a special case; i.e. it gives information about discrete sub- 
groups of R-C with compact quotient. Another such refinement is the 
following weak form of a theorem of Mostow [4]. 


Mostow THEOREM. Let T be a discrete subgroup with compact quotient 
of the. connected, simply connected solvable analytic group R. Let N be the 
nil-radical of R. Then I(TN)—=N and N/n—r (T) ON is compact. 


One could use the Zassenhaus lemma to give a new proof of the Mostow 
theorem. Let us state the following generalizations of the Mostow and Bieber- 
bach theorems: i i i 


_ Temonem 2. Let G be a simply connected analytic group with no 
compact normal subgroup and let T be a discrete subgroup of G with compact 
quotient. Further let N be the nilradical of G. Then I(TN)=N and 
N/n—r(T) ON is compact. | 


Theorem 2 follows easily from Theorem 1, the weak Mostow theorem, 
and the work in [5] and we will omit its proof. It should be noted that 
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Theorem 2 is false with the assumption of no compact normal subgroups 
removed. 
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ON THE SPECIALIZATION OF BIRATIONALLY 
. EQUIVALENT CURVES.* 


By IRWIN FISCHER. 


It has been proved by Chow and Lang [1] that the birational equiv- 
alence of algebraic curves is preserved under specialization, provided that 
the specialized curves are non-singular. We shall’ prove this result also for 
singular curves, provided that the genus of each of the specialized curves 
equals that of the original curves. See van der Waerden [5] for the case 
of plane curves with ordinary double points. 

By a curve we shall mean a positive 1-dimensional cycle in projective 
space, without multiple components. By. the genus g(Z) of an absolutely 
irreducible curve Z we shall mean the genus of its function field over any 
perfect field of definition. It does not depend on the particular perfect field 
chosen. In the following & will denote an arbitrary ground field. If Z is 
any curve k(Z) will be the field generated over k by the ratios of the coefficients . 

-of the associated form of Z. 

Later on we shall work with reducible curves. We refer to Rosenlicht 
[4] for the concepts of place, function ring, general point, etc. and for the 
Riemann-Roch Theorem for reducible curves. 

We shall call a formal sum of points on a curye a Odim. cycle. The 
term divisor will always be used for sums of places. By the center of a 
divisor we mean the cycle which consists of the centers of the places in the 
divisor, counted with their multiplicities. 

We shall make use of the following theorem, due to Hironaka. [3, p- 
194, Th. 5.] 


THEOREM 1. Let the absolutely irreducible curve Z specialize over the 
field k to the curve Z—_Z,4-Z,+---44,, where Z,2,° © +, Zr are the 
“absolutely irreducible components of Z. Then 


IZA +I) ++ +9) Sg (4). 
2 Received June 30, 1961. 
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We now state our main result. 


THEOREM 2. Let Z,, Z, be absolutely irreducible curves which are bi- 
rationally equivalent to each other (over some common field of definition). 
Let (Z,,2,) specialize over the field k to (Z,, Ža), where Z,, 2, are also 
absolutely irreducible, and are both of the same genus as Z,, Za Then Z,, 
Z, are birationally equivalent. 


Proof. Let Q be a birational correspondence between Z, and Za. Then . 
@ is itself an algebraic curve which is birationally equivalent to both Z, and 
Za. Therefore G is an absolutely irreducible curve of the same genus g as 
Z, and Zo. 

Extend the specialization given in the theorem to a specialization of G, 
yielding (Zu Zz @) —> (Žu Ža G), the arrow denoting specialization over the 
field k. l 

Since specialization preserves the operation of algebraic projection, from 
prı G= Z, and pr,G=Z, we deduce pr.G—™Z,, preG==4Z,. Hence either 
G is absolutely irreducible, in which case it is a birational correspondence 
between Z, and Z,, or it has the form PX Z.+ 2, Ö, where P is a point 
of Z, and @ is a point of Z,. In this latter case, @ has two components, each 
being a curve of genus g, neither of them being multiple components. By 
Theorem 1 we obtain 2g =g +g Sg. If g>0 this is impossible. This 
proves Theorem 2 for g>0. For g=0 the conclusion of the theorem is 
trivial. 

Our result is an immediate consequence of Hironaka’s inequality (Theorem 
1). It may be of interest to see that, if g >1, it follows from a weaker 
inequality, which can be proved in a simpler fashion. 


THEOREM 3. Let the absolutely irreducible curve Z specialize over the 
field k to the curve Ë == Z,+ 2, +": +Z, where Ž,, Ža: +--+, Zr are the 
absolutely irreducible components of Z. Then 


g (41) + 9(42) +: g) rH Sg). 


Proof. We can assume that k is an infinite field, by adjoining a trans- 
cendental if it is finite. Let Z, Z lie in a projective space of dimension n. 
We can then project Z, Z from a suitable (n — 3)-dimensional subspace into 
a plane in such a way that the projection is birational on Z and the com- 
ponents of Z. We can therefore assume without any loss of generality that 
Z, Z are plane curves. 
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We can give the set of all forms of degree h in the indeterminates 
X, Xu Xz, with coefficients in the universal. domain, the structure of a 
projective space V, by taking these coefficients to be projective coordinates. 

Let U be the subspace of V which consists of all forms which vanish 
on Z. Let W be a complementary subspace to U in V, chosen in such a 
way that it is defined by homogeneous linear equations with coefficients in 
the prime field of our universal domain. Then if m = order Z = order Z, 
we have for h large enough, 


dim W =h (h +3)/2— (h—m +1) (h—m +2)/2 
— mh — (m +1) (m +2)/2. 


W is a maximal linear subspace of V which contains no form that 
vanishes on Z. No form in W vanishes on Z. We can see this as follows. 
Let F be a form in W which vanishes on Z. Extend the specialization Z —> Z 
to one of F, obtaining (Z, F) — (Z,#), over the field k. Since W is defined 
by linear homogeneous equations whose coefficients lie in k, we have Fe W. 
But P vanishes on Z, which leads to a contradiction. Therefore no form in 
W vanishes on Z, and W is a maximal linear subspace with this property. 

Let m, = order 2, t—=1,2,--+,r. Let W; be the linear subspace of W 
which consists of all forms in W which vanish on Z. A simple calculation 
shows . 


dim W, = (m — m1) h + m(m—3)/2— (m—1)(m—2)/2, t= 1,2, > +7. 


The adjoint forms of order h in W cut out complete linear series on Z. 
(Gorenstein [2]). If we denote the degree of the adjoint divisor by v, it 
follows from the Riemann-Roch theorem that for h sufficiently high we have 
mh—v—g-+-1 adjoint forms in W which are linearly independent over the 
field k(Z). These forms determine a linear subspace S of W, with dimS 
== mh — v — g. . yegi mer 

Let C be the center on Z of the adjoint divisor of Z. 

Extend the specialization Z—> Z, over the field k, to (Z, S, C) > (2,8, 0). 

From dim § = mh —v—g, we find that for sufficiently high h, & is not 
contained in W, +=1,2,:-+,r. Hence it follows that ‚almost all forms in 
§ do not vanish on any component of Ž. 

There are a finite number of divisors 4,,4.,-.- +, Aq of the reducible 
curve Z whose centers on Z equal G. Consider the set of all forms g in W 
such: that vp(ġ) =,(4,) for all places p of Z. These conditions being 
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linear we obtain for each j a linear subspace W;* of W, j =.1,2,: > +,q. Those 


members of § which intersect Z properly belong to U W,*. Since almost all 
members of § (namely those not in U Wi) intesa Z properly, we have T 
SC ú W,*. Therefore § C W” for sme j: Dropping the subscript, we call | 


the Greene divisor A, and see that %(g)Zw(A) for every form ğ 
in §. We may, of course, have vp(ĝ) =». 
Let & be the algebraic closure of k(Z). Le 


* Gos G1" “sfa (s—=mh—v-+ 9) 


be a linearly independent set of forms in § such that go intersects Z Z properly. 
Let F be the intersection divisor of the form ĝo with: 2: Then. if’ (Yo, Yı, Ya) 
is a homogeneous general point of Z over k, set 


sale Yı, Y2) /Go( Yo, Yu Yo), j= 0, 1, + +8. 


Let D=E—A. We have proved above’ that -vp(Go) = v,(4) for every 
place p of Z. Hence D is an integral divisor. Also vo (9) Z K for every | 
p and j. 

Let L(D) be the vector space of al functions ¢ in the function ring of Z 
satisfying vp(¢) =—v,(D) for all places p of Z Then ¢)=1,¢1,¢s° °°; 
p€ L(D), hence dim L(Ð) =mh—v—g+1. ‘By the Riemann-Roch 
theorem for reducible curves, we have dim L(D) =d(D)—g+1+1(D), 
with eg) + A) + rt | 

For h sufficiently high, D is a non-special divisor since the degree of its 
projection on Z; can then.be made larger than 29 (Z,) —2, for each j.. Hence 
if this is done we have 1(D) —0, and it then follows that mh—v—g+t1 
Z= mh—v—g +1, or gSg. This is the desired conclusion. 

If g > 1, Theorem 2 follows from Theorem 3 by me same argument used 
previously to deduce it from’Theorem 1. 

We have stated our result on. the specialization of birationelly equivalent. 
curves only for specialization over afield. Hironaka proves Theorem 1 for ` 
specializations over a discrete, rank 1 valuation ring of finite type. Our proof 
of Theorem 3 holds for specializations over any discrete; ‘rank 1 valuation 
ring. From these remarks it follows that if g > 1, Theorem 2 holds for 
specializations over discrete, rank 1 valuation rings; while if g—1 it holds 
at least under the additional assumption that the rings are of finite type. 
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For non-singular curves, Chow and Lang have proved the theorem for 
specializations over any discrete, rank 1 valuation ring. 


UNIVERSITY OF COLORADO. 
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COHOMOLOGY OPERATIONS WITH LOCAL COEFFICIENTS.* ? 


By SAMUEL GITLER. 


0. Introduction. The study of cohomology operations has been one of 
the important areas of research in Algebraic Topology for the last twelve years. 
They have been applied extensively to compute obstructions [18], to study 
the homotopy type of complexes [22] and to show essentiality of maps of 
spheres into spheres [3]. 

One of the basic operations is the reduced powers of Steenrod P+ [1], 
[19], [20]. If X is any space, @ a cyclic group of prime order p, then. P+ 
is a natural homomorphism. 


Pt: He(X;4G) > Hered (7; G) 


t==0,1,2,---+, where H’(X;@) is the r-th dimensional cohomology group 
of X with coefficients in G. 

Steenrod [16], [17] and Reidemeister [15] independently generalized 
the concept of cohomology with coefficients in a group @ to cohomology 
with coefficients in a local system of groups with basic group @; the local 
system of groups is characterized by an action of the fundamental group as 
automorphisms of G. 

In this paper, the definition and theory of the reduced power operations 
Pt is extended to the case of cohomoloy with coefficients in a local system of 
groups whose basic group is a cyclic group of prime order p32. 

All of the standard properties, when suitably interpreted bold in the 
extended theory. Furthermore there is only one extension which preserves 
these properties. 

Examples are given of spaces which are distinguished by the Pt with 
non-simple coefficients, but which other known’ cohomology operations fail to 
distinguish. : 

Eilenberg [6] has shown that the cohomology theory with a local system 
of groups is naturally eqiuvalent to a theory of equivariant cohomology in 
the universal covering space with ordinary coefficients. 


* Received April 9, 1962. 

1 This paper contains the main results of a Doctoral Thesis developed by the author 
under the guidance of Prof. N. E. Steenrod and submitted to Princeton University in 
1060. 
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The construction of the Pt is done with respect to this equivariant 
cohomology, and is based on the p-fold cartesian product of a space X, and 
the cyclic group of permutations of the factors, just as in the case of simple 
coefficients. 

A second approach to cohomology operations with simple coefficients is 
provided by the Eilenberg-MacLane complexes K(G,q) [4], [7]. A well 
known theorem establishes a one to one correspondence between cohomology 
operations and cohomology classes of K(@,g). 


_ The complexes K(G,q) are readily generalized to study cohomology 
operations with local systems of groups by this method. The generalized 
Eilenberg-MacLane complexes L(G, q) are complexes with only two non- 
vanishing homotopy groups, one of them the fundamental group which is r, 
the other is G in dimension q. The k-invariant is zero, but the complex is 
not a product because the fundamental group of the base operates non-trivially 
in the fibre. : 

Finally we show that the set of cohomology operations with initial and 
terminal local systems of groups with basic group cyclic of order p > 2, has a 
basis of: addition, cup products, Bockstein and Pt, which is the exact analogue 
of the results with ordinary coefficients (cf. [4]). l 

This paper has been divided into four chapters. Chapter I reviews briefly 
- the cohomology theory with local coefficients, and its relation to an equi- 
variant cohomology of the universal covering space. In chapter II we define 
the ?* and state their basic properties. Chapter III deals with the generalized 
Hilenberg-MacLane complexes Lx(G,q) and cohomology operations in general. 
Chapter IV contains the proofs of some of the theorems of chapters IT and III. 


Chapter I. 


Cohomology with local coefficients and covering spaces. 


1. Cohomology with local coefficients. By a space X, we will under- 
stand a space which is semilocally one connected,? pathwise connected and 
locally pathwise connected. 

. We assume we are given a local system of groups & =={G,} on X as 
defined by Steenrod [16]. A mapping f: YX induces a local system of 
groups f*& on Y. We may then consider the cohomology groups H*(X; $) 
and H*(Y;f*&) and the induced mapping: l 


2 See [16], p. 64. 
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f*: H*(X;8)> H*(Y;f*&). 


In this paper we consider always simplicial singular cohomology [6]. ° 
Often it is more convenient to restrict the local system of groups tw a 
"local group in the sense of Olum [13]. They are naturally equivalent. 
“We will consider both methods in this paper. 


2. Pairings of local systems and cup products. Let 8, be a local 
system of groups over the space X, (1,2). Then in an obvious way 
(HB G,)o,2,} is a local system of coefficients over the cartesian 
. product X, X Xa. E X,—X,—X, denote by 10H, the induced local 
system of groups on X corresponding to the diagonal mapping d: X > X x Z. 
&,°%, is called the product of &, and &.. &* will denote the product of 
§ with itself n-times. 

-> One is interested in the isomorphism classes of local systems of groups. 
In this sense, the above product is associative and commutative. Moreover 
-if &,, $, are local systems of groups, then we have defined a cup product 
pairing [16]: 


(2.1) U eee ON 


which is natural, associative and commutative (in the senise of graded objects). 
We will be particularly interested in local systems. whose basic group is 
a cyclic group of prime order 'p 342. 


2.2. Let 9,(X) denote the set of all isomorphismi classes of local systems _ 
of groups over X with basic group a cyclic group of order p. By H*(X;$,) 
we will denote the bigraded prop with bidegrees (q, 8) where q is an integer 
= 0 and BEY (X). . 

Every class in $,(X) has a representative whose basic group is the 
additive group of Z,, the integers modulo p. 


$o(X) is an abelian group under the product HoH, Its unit 
ts be 8 of) the trivial local system of groups, and every element & € $(X) 
has finite order m, where m divides p—1. 


From the definition of the product, it is clear that it passes to classes. 
Assoeiativity and commutativity follow from the corresponding properties in 
the tensor product. Thus $,(X) is an abelian monoid with unit the class of 
- the ordinary coefficients Zp. We may consider a representative &, of a class 
in $p(X) to have basic group: Zp. By Section 1, 4, is uniquely determined 
by a local group Gæ i.e: a homomorphism: m: (X, £o) —>A(Z,) where A(Z,) 
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is the automorphism group of Ge. Now A(Z,) is cyclic of order p— 1, it 
then follows that $,(X) is in 1-1 correspondence with homomorphisms 


m(X)>A(Z,) 


i.e. (X) <>Hom(H,(X),A(Z,)) and in such a way that this is an iso- 
morphism of groups. 


2.4. If {8} denotes the subgroup generated by & in (X), 
H*(X;{&}) is a subgroup of H*(X ;$,) and we have: 


H* (X39) is a commutative; associative, bigraded ring under cup 
products; for every HE 9,(X),H*(X;{H}) is a subring; and if f: Y >X 
is a mapping, then f induces a ring homomorphism : 


fF: H* (X; 3) > H*(Y ; $o) 
so that if & € 9,(X), 
ft: H*(X;8) > H*(7;f*$) 


x. 


The above statements follow easily from the properties of cup products 
and (2.2). 


3. Covering spaces and local systems of groups. In this paragraph 
we obtain some results relating the cohomology with local coefficients on a 
space X and the ordinary cohomology of its universal covering space. 

We now consider spaces with base points, so that mappings preserve 
base point. 

Let X be a space, x, its base point. Then X will denote the universal 
covering space of X based at zo. (cf. [6]). X is a covariant functor in the 
category of spaces with base point. Let p: ¥—» X denote the projection. 

If now & is a local system of groups on X, @, the local group at x, 
then m (X,2,) operates in X as group of covering translations, and on Gy. 
Relative to this action we may form H,¢(X;G,) the equivariant cohomology 
groups of X with coefficients in Ge. For their definition and the following 
main theorem we refer to [6]: 


3.1. THrorem (Eilenberg). The projection p: X>X induces an 
isomorphism : 


p*: H(X;8) > H(X; G) 


for all q, which is natural with respect to mappings of spaces with base point. 
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3.2. Now assume that r == m, (X, to) is finite of order m. ne have 
a natural mapping : ` 
(3.3) i i: Het (£3 Gy) > H*(X; G) 
induced by the inclusion of cochains and a transfer homomorphism (et. [6] ; 
[21]). 
(3.4) Tr: H*(Ž; G) >H*(X;6,) 


defined in the cochains by: Tr(f) = 2 sf so that in cohomology: 
(3.5) Tr (x) = me. 
Now = operates in H*(X;G,), so let: 

H*(X;G,)" = (ze H* (X53 Go) | st==« for all ser). 
Then the following proposition is true: 


3.6. If multiplication by m ts an automorphism of Go, then 
i: H(X; G) > H*(X; Go) 
is a monomorphism, and its image is H*(X ; Ga)". 


Proof. Multiplication by m in the coefficient group Gà induces an auto- 
morphism 7: H,*(X; Go) > H.*(X;G,) with n(z) =mz for all x. Hence 
(Tr) ¢() =z implies į is a monomorphism. 

Also if v€ H *(Z; Qo), 2 a representative cocycle of x, then 4 ®) is also 
‚represented by z; but since sz =— z for all s, we have į (x) € H*(X;,G,)". 

Conversely if y€ H*(Ž; Go)” and w is a Pe nn then 
sw—w for all s€ v, hence in cochains: i 

. 4 Tr(w) = E sw~ mw, therefore 4 Tr(y) = my 


acr 
But by the assumption we may divide by m, and thus y€ imi. (3.1) and 
(3.6) thus give: 


3.7. Let & be a local system of groups on X, G, the local group at ao, 
X the universal covering space of X at 2. Then tf r—m(X,2,) is of 
finite order m so that multiplication by m ts an automorphism of G then 
p: X—X induces a natural isomorphism: 


pr: H*(X;9) H*(Ž; G)". 
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Chapter II. 


Reduced powers in equivariant cohomology. 


4. Definition of the reduced powers. In this section we extend the 
‘definition of the Steenrod reduced powers to equivariant cohomology. We 
recall that the definition of the reduced powers with ordinary coefficients in 
a space X (cf. [2], [21]) is based in a “chain approximation” to the 
diagonal d: X— X” which behaves properly with respect to the action of a 
permutation group r of the factors of X”, where X* is the n-fold cartesian 
product of X with itself. 

Let p be a group, then by a p-space X we will mean a space X on which 
p acts without fixed points. 

We will start with a p-space X, then X* is also a p-space, under the 
diagonal action: 


s(21,° i `, En) = (8%,,° 7 * , SEn) 


where s€ p, (@1,° © ‘t) € X”. If x is a group of permutations of the factors 
of X”, the action of p and m commute, so that = X p is a group of operators 
in X”. The construction of the reduced powers with equivariant cohomology 
will then be based in a chain approximation to d: X—>X* which behaves 
properly with respect to the action of m X p on X". 


Special assumption. Throughout this section, the coefficient group @ 
will always be a cyclic group of order p(p prime > 2). 

Let X be a p-space, G a p-module, then we may consider as before the 
equivariant cohomology H,4(X; G). 

For every g, let M(q) be the elementary cochain complex having only 
one non-zero cochain group in dimension q, with generator u, of order p. 

Then to every class we H,2(X;G) we associate a class C(u) of cochain 
homotopic mappings: M(q)>C.*(X;G@), so that if fe C(u), f*(u,) =u. 
The elements of C(u) are called cochain representations of u. 

Let m be a subgroup of the symmetric group of degree p, then the con- 
struction of the z-reduced powers of a class we H.<(X;G) is based in the 
following diagram (compare with [21]): 


a $ 
(4.1) W 8r M? —— W Qr (C,* (X ; G) )?» — 0% (Z; G) 
where we need to explain the undefined terms: 


W is a w-free acyclic complex, M—M(g), MP and (C.*(X;@))? are 
the p-fold tensor products of M and C,*(X;G@) respectively. 
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W® (C,*(X; G))? is the tensor product of a chain complex by a cochain 
complex, and is a cochain complex as defined by Steenrod. M” is a cochain 
complex with only one non-zero cochain group in dimension pq, which is 
cyclic of order p, generated by 1”. m operates in Mr by the sign of the 
permutation if g is odd, and trivially if q is even. The action of ~ in W@ Mr 
is the diagonal action, In (0,*(X:@))? the operations of + are defined by: 


m: -@ry) el) ®: + Dry, DUD: + Ory, | 
where e(a) — (—1)simedimews if @ is the simple interchange of the i-th and 
(i -+ 1)-factor. We remark that 

(md Dup): (oc) =u: Dup: (ae). 
In W8 (C.*(X;G))*, m acts diagonally. 
‘As to the mappings, y is induced by a cochain representation 
f: M>0#(Z;0),\.e.y=1®P. 
Now ¢ is to be dual to a chain mapping: 
9: WCX) —> (Cy) X))? 


which is ~ X p-equivariant, where m Xp acts on W@C,(X) so that r acts 
in W, p on Cy(X), while the action of r X p on (C,(X))? is the one induced 
by the action of mX p on X?. The existence and uniqueness of ¢’ is pro- 
vided by 


4.2. Let X be a p-space, m a permutation group of degree p. Then 
there exists a m X prequivariant chain mapping: , l 
TE g: WOO, (X) > (0,(X))? 
satisfying : i 
P (WBT) = %O- + Oxy 
where Wo, ©, are vertices of W and X respectively. 


If $” is another such mapping, then ¢’ is v X p equivariantly homotopic 
to $”. , 


The proof of this and the following proposition is obtained by using the 
theory of acyclic models and will be given in Section 9 (9.1). 


The mapping ¢’ also satisfies a naturality condition. Let (X,p) be a 
pari consisting of a group p and a p-space X. A mapping: 


f: (Z, p) > (X, p) 
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consists of a mapping: X > Y and a homomorphism p— p’ both denoted by f 
so that: 
f(st) —7(s)f(z). 


A mapping ¢’ such as in (4.2) is called a diagonal approximation: 


4.3. Let f: (X,p)— (¥,p’) bea mapping, and let di, pa be diagonal 
approximations in X and Y respectwely. Then f induces a diagram 


WEN (0,(2)} 
[ios |» 


2 


W@C,(¥) —> (¢,(Y))? 
which is commutative up to a homotopy which is equivariant relatiwe to the 
mapping 1X f: rXp>rXp. 

Let now ¢’: W@C,(X) > (C(X))’ be a diagonal approximation as 
in (4.2) ; define 
l go: WQ (C*(X; @))?—>0*(X; GP) 
by: 
(4.4) ~ do(w@u@- - Quy) o (— 1) Yu, @- - - Quy: p (wo) 
where i— dim v, u,@---@u, is an n-cochain of (C*(X;G@))?, o is an 
(n—+t)-simplex of X, G is a p-module and G? is the p-fold tensor product of 
G with itself. 

The equivariance of ¢’ gives in a straight-forward manner that œo is 
actually defined in W &, (C*(X; G))?. 

Now the inclusion: 

, i : O6*(X; A) > C*(X; G) 
induces a natural mapping 


j: W & (C.*(X;G))? > W r (C*(X; G))? 


and again it is not hard to see that oj sends W & (C,.*(X;G@))? into 
' C* (X; @). Thus we obtain 


poj: W Qr (0 (X; G))? > C,* (X; G) 


which is a cochain mapping as may be easily verified. 
But now if G is cyclic of order p, the mapping 
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(4.5) l X: >G 
defined by picking a generator T of G and setting 
X(TX---XT)=T 


is an isomorphism, independent of the choice of T. Furthermore X is natural 
with respect to isomorphisms of cyclic groups of order p, it induces then a 
natural isomorphism : 


X: 0# (X; @) > C,*(X;@) 


and $ = Xġoj. i 
We now return to (4.1) having defined all the terms, and we define: 
(4. 6) d: H?(W®, Me) > H.a(X;G) 


to be the composition (dw) *. 


The &-image of H*(W@, M?) is called the set of m-reduced powers of 
the class ù. 


There were several choices made at various stages, and now we will see 
the degree of freedom involved in these choices. 

4.7. ©: H*(W @y li?) > H,*(H;@) is independent of 

1) The cochain representation of ü 

2) The diagonal approximation ¢’ 

3) The particular x-free acyclic complex W. 

The proof of 1) is that of Steenrod in [20]. 


_ As for 2), let $” be another diagonal approximation, then by (4.2) ¢’ 
and p” are m X p equivariantly homotopic, i.e. there exists a mapping: 


D: WC, (X) > (C,(X))? 
of degree + 1 with: 
6D’ + Dd = g — p” 


and D’ is m X p-equivariant. I£ we now define 
À D's: WO (O*(X; G))# > 0*(Z; Gr) 
i Dwn È: - -@ vy): (0) = (16D: - -Dv D (w80) 
then as in the case of ¢’, D’, passes to give: 
Dy: W@x (C,*(X ; G?) > 0* (X; Gr) 
Then if we set D—XD,, one easily verifies that D is a cochain, homotopy 
connecting ¢ and ¢o, duals of ¢’ and ¢”. We finally prove 3) as follows: 
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Let x’ be a subgroup of a, V a w’-free acyclic complex. It is well known 
that the inclusion =—r is covered by a unique homotopy class of ’-equi- 
variant mappings 9: V>W. Let #: W80,(X)> (C,.(XZ))P bea rX p- 
equivariant diagonal approximation, then ¢,—¢/(g@1) is a =’ X pequi- 
variant diagonal approximation and we obtain a commutative diagram: 


(4.8) 
v8 (0# (X; G) 


g@1 . 0.7 (X;@) 


Wr (0# (X; G))? 


From (4.8) one clearly obtains 3) plus the important fact that (4.8) in 
cohomology tells us that all -reduced powers are S(p)-reduced powers, 
where S(p) is the symmetric group of degree p. 

We study now the behaviour of reduced powers with respect to mappings. 
Let ®, denote the mapping (4.6) defining the x-reduced powers of ü. 


4.9. Let f: (Y,p)— (X,p) be a mapping, G a p-group ve HA(X; G). 
Then f induces a commutative triangle: 


where v = fu. 
Proof. In the cochains we have: 
(4. 10) 


y W 8r (0* (X; 0) ——> C* (X; G) 


W Br MP | vor (fr)> ft 


Yo WQ (C.2(¥ ; @))? ——> 6. (¥ ; @) 
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and the triangle can be chosen commutative by (4.7). It remains to study 
the right square. If one considers the dual diagram: 


W®04(¥) — (0,(¥))* 
18% (fa)? 
W80,(X) — (04(X))? 


then (4.8) asserts it is commutative up to 1X j-invariant homotopy. The 
dual of this homotopy makes the aquare in (4.10) commutative up to 
homotopy. 


4.11. We remark that there is a natural isomorphism : 
y: Hr(r; Zp) > Hrt (W Bs HP) 


where Z,@ denotes the integers modulo p, and r acts in Z,@ by the sign 
of the permutation if q is odd and trivially if q is even. l 

If we take ~ to be the cyclic group of order p, p 2, then every permu- 
tation is even, so that the action on Z,@ is trivial. We may then consider 
the inclusion in homology: 


hy: Hela; Zp) > Hy (8 (p); Zp) 


then Steenrod [19] shows that if q is even hap = heri =0 if 2k is not an 
even multiple of p— 1, and if g is odd, he, == hax- =0 if 2k is not an odd. 
multiple of p—1. An immediate consequence of this is Thom’s theorem: 


4.12. THEOREM. If pis an odd prime, r = cyclic group of order p, 
then © (Hrr*(W Qr MP)) == 0 unless the change in dimension (pq—k) —q 
ts congruent to 0 or 1mod2(p—1). 


Another reduction in the study of cyclic reduced powers with ordinary 
coefficients is the relation between even and odd reduced powers: 

Let € Hr(m;2,), GE HA(X; G), then if we set é(ū) = Bz(y(é)) the 
relation in question is: j 
(4.13) (Bxé) = B*(E(R)) 


(ef. [19], p. 217). 
Here 8, is the homology Bockstein and 8* is the cohomology Bockstein 
associated with the exact sequence: 


(4.14) 0> 4,7 Zp Z> 0. 
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We now introduce Bocksteins in equivariant cohomology and show that 
(4.13) holds with respect to equivariant reduced powers. Let 


0> @’ > G> G’ 30 


be an exact sequence of p-modules. If X is a p-space, then we have an exact 
triangle: 


l t 
H,*(X;@’) —— H,* (Z; G) 
3* j 
H,*(X; @”) 
where íi, j are of degree 0, 8* of degree + 1. 
If now Z, is a p-module, then (4.14) can be made into a p-sequence by 
lifting the action of p on Zp to an action of p on Zu: as follows: 
Let A(Z,), A(Z,:) denote the automorphism groups of Zp and Zp 


respectively. Let k be a primitive root of the prime p, and T the generator 
of A(Z,) corresponding to k; i.e, T(1) =k. Define 


L: A(2,) > A (pt) 


by 
L(T) (1) =k mod p. 


Then L is a homomorphism so that T,—L(T) acts in pZy compatibly with 
the injection 0 —> Z,— Zp. 

The lifting L is independent of the choice of the primitive root k of p. 
For let & be another root and T” the corresponding generator, then T” == T! 
for some s with (,p— 1) =1, so K = k’ mod p i.e. K = k! + Ip mod p°, and 
then if L’ is the lifting associated to #, 


L (T) (1) =k = (ke + Ip)? = k = L(T*) (1) mod p? 


With this lifting L we make Z,» into a p-module and obtain in the usual way 
an equivariant Bockstein p*: 


(4.15) ß*: Ha(X ;2,) > H(X; Z) 


for any p-space X, where the action of p is the same in the initial and terminal 
coefficient. It is easily verified that 8* is natural with respect to mappings. 
(X, p) > (Zp). 


4.16. The cyclic reduced powers satisfy ihe relation: 
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| (Bat) (0) =8*(E(@)) 
for any class §€ Hy (7; Zp) and any üe H.*(X ; Zp), where By is the ordinary 
homology Bockstein and ß* is the equivariant cohomology Bockstein. 


The proof of (4.16) will be given in $9(9.2). 


5. The operations P! and local coefficients 

5.1. Let Ge H,4(X;G), then following Steenrod [19] set: 
(5.2) Pia = (— 1) emed (m!) aw gs) (%) 
where m = p— $ and wiegen (p-ı) is a generator of Hie- (p41) (7; Zp). 

Thus: , 
(5.3) Pt: A(X; G) > Ht (X; G) 

5.4. Let X be a space with base point To, X its universal covering space 
at zo, then by (3.1) 

p*: H*(X;8) =H,#(X;G.). 

We define the operations Pt in the local coefficients & (with basic group a 
cyclic group of order p > 2) by 
(5. 5) Piu = p* Pi (pea), 
Thus: Pt: H9(X;%) > Herten (X;$&) and they can be extended to the 


relative case just as the simple Pt. We now state the elementary properties 
that the reduced powers P! with local coefficients satisfy : 


5.6. THrorem. The Steenrod powers {P*} of (5.5) are a sequence of 
functions from H*(X ; 3p) into itself with the following properties: 


1) They are natural mappings 
l Pt: H(X; 8) Hro (X; 9) 
for every $ € 9 (X) 
2) They are homomorphisms 
3) P° is the identity homomorphism. If uc H(X; $ ), then Piu = 0 
tf 8 > q/2 and if q is even PU2y — ur in the sense of cup products.3 
4) If ue H(X; 8), ve H(X;G.), then uy EHe (X; Hoge) 
and Pt(u U v) = X PU Pry 
a+b=i 


* If G € Z (Z), then the p-fold cup product of a class u of H*(X; G) again lies in 
H*(X;G). 
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5) If Y is a closed subspace of X, g: Y>X the inclusion and 
8: H9(Y, 9*&) > H(X, Y; $) is the coboundary operator of the 
cohomology sequence of the pair (X,Y), then 
Pi — Spt 
6) P? restricted to a simple system of coeficients can be naturally 
identified with the reduced powers of Steenrod. 
(1) follows easily from (5.3), (5.5), (3.1) and (4.9); (2) to (5) will be 
proven in 89(9.3). 
As to (6) we need to remark only that when & is a simple system of 
groups, (4.3) when applied to 
p: (X,m(X,20)) > (X,¢) 


where e denotes the group of one element, gives us a commutative diagram. 


pi 
H(X ; Qo) ——> Ho!) (X; Go) 
p* p* 
pi 


H,a(X ; G) — Hae (X; Go) 


where in the upper line, P* is the reduced powers of Steenrod with ordinary 
coefficients. 


(5.6)-(6) and (3.7) will allow us to compute reduced powers with local 
coefficients in terms of reduced powers in the universal covering space. 


6. Example of spaces which are distinguished by ?! with non-simple 
coefficients. We construct two spaces M, N so that no primary operation 
with ordinary coefficients distinguishes them as to homotopy type, but which 
a Pt with local coefficients distinguishes. We only show that Pt with local 

. coefficients distinguishes them, and leave it as an exercise to the reader to 
verify that no primary operation does. 

Let K denote the complex projective three space (real dimension 6), 
L the union of the complex projective plane with a 6-sphere with a single 
point in common, so chosen that it has real coordinates in the projective 
plane and lies in the equator of the sphere. 

Let o denote the cyclic group of order 2, and let the non-trivial element 
of æ operate in K by complex conjugation. In Z let it operate by complex 
conjugation in the projective plane, and by reflection along the equator on 
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the sphere. Let sK and sL denote the suspensions of K and L. ‘The opera- 
tions of g extend by suspending the mappings. 

Let M be the identification space of (unit interval) x sK under the 
relation (0,4) — (1,ga) where a€ sK, g is the operation in sK of the non- 
trivial element of o. Construct N similarly, using sL. 

Let I, denote the twisted integers mod 3, i.e. the integers mod3 on 
which o acts by change of sign. 

Now we have: 


6.1. The operation P+: H*( ;1,) > H"( 313) distinguishes M and N. 


Notice first that by construction M and N have the same six-skeleton also 
a, (AL) a, (N) = Z and if y: Zo is the natural projection, we may use 
it to define local systems of groups I, on M and N. 

Let A be the unit interval, then: M = A X sK, N=AX sL and in both 
cases one can easily check using (3.1) the following isomorphisms: 


pit: H* (i313) = H#(AXsK;Z,) 
p:*: H*(N 313) = H*(A X sL: Zs) 


where the equivariant cohomology is taken with respect to the action of o. 
If we apply (3.6), we obtain natural isomorphisms: 


H*(M;1,) Z H*(A X 8K 3Z,)* = H*(sK ;2,)° 
H*(N ; I) = H*(A X sL; Za)? = H*(sL32,)*. 


Now it is easily seen that H4(sK ; Z.) =Z, for g—0,3,5,7 and also 
He(sL; Zs) == Z, for q= 0,3,5,7. If u, is a generator of H*(sK;Z,), t 
the corresponding generator in H? (sL; Z) then both u, and us are invariant 
under o, hence P’u, and Prus are also invariant. Now Piu, s40, Pru, =a 0 
for u, ==.S*il,, Ue == s*ü, where s* is the cohomology suspension and it is clear 
from the construction that ŭ,? s4 0, ü, = 0. Hence 
Piu, = Pit, — s* Pj, 40, 

for Pü, == U and Puk == 0. 

Tf we take the corresponding elements to u, and us in the cohomology 
with coefficients Is, the above inequalities hold. 


Example of spaces for which Pt for ¢>1 distinguishes them as to 
homotopy type are obtained by taking higher dimensional projective spaces. 


6.2. We may remark that the Pt with non-simple coefficients G (cyclic 
of order p) do not give any information on H-spaces or homogeneous spaces, 
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for one can prove that the cohomology with (non-simple) local petioles 
in @ of such a space is totally acyclic. 

This tells us that to find non-trivial applications of Pt with non-simple 
coefficients Zp, one should look at spaces which are far from being H-spaces. 


-Chapter III. 


Cohomology operations with local coefficients. 
7. The complex Lz(G,q). It universal character. 


7.1. In this paragraph we define the general concept of cohomology 
operations with local coefficients; this is done in the category of Kan com- 
plexes (cf. [12]). 

By a complex, we will mean a Kan complex. 

Let X be a complex, we will say it is one-vertexed if the 0-simplices 
consist of a single element a, and by m(X) we denote the fundamental 
group of the one-vertexed complex. If G is an abelian group having m, (X) 
as group of operators, then G is a local group at z, in the sense of Section 1, 
and we may then speak of the cohomology of X with local coefficients in G. 
To stress the way in which m. (X) operates in G, let kh: 1,(X)—-A(G) be 
the mapping defining @ as a m (X)-module; then H*(X;h,G) will denote 
the cohomology groups of X with local coefficients in G. 


1.2. Let m be a multiplicative group, by £r we denote the category 
whose objects are pairs (X,a), where X is a one-vertexed complex and 2 a 
homomorphism 7,(X)— vr. 

The mappings f: (X,«)—> (Y,ß) of £x are semisimplicial mappings 
f: X — Y with the restriction that they should induce commutative diagrams: 


Tr 
m(£)——m(Y) 
(7.3) a ß 


Let G be a group having ~ as a group of (left) operators, that is we are given 
hir>A(G). Then for every (X,a) € £r, we have a local group us G), 
and if f: (X,«a)— (Y,ß) is a mapping, then f induces 


(7.4) ft: H* (Y; hg, G) > H* (X; ho, @). 
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7.5., Let G, @ be abelian groups, h: 7->A(G), h’: r>A(G’) be 
“mappings defining the module structures over x, then by Ox(h, G,q;h’, 9g’, n) 
we denote the set of cohomology operations: 


T: HY ;h,G)—>H"(-;h’,@’) where for every (X,a) € Im, 
T(X,a) isa function: 
T(X,a): H(X; ha, @) > H*(X;h’a, @’) 
which is natural with respect to mappings f: (X,«) — (Y, 8), that is, satisfy : 
TT, B) =T(X,a)f* 


7.6. In Chapter I we reduced the study of cohomology with local 
coefficients to the study of equivariant cohomology in the covering space. 

We define now the semisimplicial analogue of universal covering space 
following V. K. Guggenheim (cf. [9]). 

Let X be a one-vertexed complex and let r =m, (X). Then we form a 
new complex X so that: 

X, =r X Xu 

with face operators 


(y, T) m (y, dx) for 0<tin—dimze 


and do(y,) = (ytve, 69%) where Wa is the class in m corresponding to the 
leading edge of x, i.e. the edge @,0,- - -0,4; and degeneracy operators: 


ly, t) = (y, sr) OStSn. 


To verify that Y is a complex which satisfies the usual properties of a uni- 
versal covering space one uses the description Kan has given (cf. [10]) of 
the fundamental group of a one-vertexed Kan complex. 
If f: XY is a mapping of complexes, then f induces: 
f:X>Y 
by 
Fe) = (fay Fe) 


where fy:m(X)—>m(Y) is the homomorphism of fundamental groups 
induced by f. (X) operates in X freely by multiplication on the first factor, 
and if f: X>Y is a mapping then F: (X,7,(X)) > (¥,m(Y)) is a mapping 
in the sense of (4.3). 

The Eilenberg Theorem (3.1) holds in the category of one-vertexed com- 
plexes, and we restate it for convenience:. 
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7.7. Let X bea one-vertexed complex, n its fundamental groups (h, G) 
a local group at Te then the projection p: XK>X, defined by p(y,2) =f 
induces a natural isomorphism : l 


p*: H*(X;h,G)>H,#(X;G) 


7.8. We recall that the cartesian product of two complexes X and Y is 
the complex X X Y whose n-simplices are ordered pairs of n-simplices, one 
of X and one of Y; the face and degeneracy operators are the face and 
degeneracy operators applied to each factor. We want to construct a sequence 
of one-vertexed complexes associated with a multiplicative group m and a r- 
module G. We proceed as follows: 

Let W(r) be the standard free acyclic complex corresponding to the 
group ~, i.e. the n-simplices of W (r) are ordered (n -+ 1)-tuples of elements 
of m, with face and degeneracy operators: 


ĝi (dos > * An) = (Ay, nun" © " 0) 
and 


Si (do, ° `, An) = (o °°, Qi 1,001," | dy) 


where 1 is the unit of m and = operates in W (r) by diagonal multiplication. 

Let K(G,q) be the standard Hilenberg-MacLane complex (cf. [7%]). 
K(@,g) has a single non-vanishing homotopy group which is G in dimension 
q. It is one-vertexed. The n-simplices of K(G,q) are in 1-1 correspondence 
with Z2(A,;@) the group of normalized g-cocycles of the standard n-simplex 
with coefficients in G. The face operators are induced by simplicial mappings 
An- > A, which imbed A,_, as face of A,, the degeneracy operators induced by 
the projection: py: Anıı > An, where: 


m(j) =} if fst and u(i) =j—lifj>t. 
Let W(x) X K(G,q) be the cartesian product of W (r) and K(G,q). 
Since = operates in G, it operates as semisimplicial automorphisms of K (G, q) 
and we let m operate in W(r) X K(G,q) diagonally, then Lx(G,q) will 


denote the complex obtained from W (r) X KE (G, q) by identification under ~. 
Le (@, q) is one-vertexed. t 


7.9. Lx(@,g) is called the (r, q)-universal complex in dimension q. 
W(x) X K(G,g) is m-equivariantly isomorphic to Le(G,q) under the 
mapping: 


(7.10) 65: W(x) XK (4,9) > L(G, 9) 
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given by: 
(7.11) 9( (do, ° j `, an), Ta) = (to, [@o; G15 ° ` On, Tu] ) 


where [aos * `, On, 4] is the class of ((@o,: - -,@),@,) in Le(G,q). 
By (7.10), when we speak of the universal covering of Lz(G@,q), we will 
have in mind W (r) x K(G,q). 


7.12. We now show that L(G, q) has a canonical class in _ 
Ha(Le(G, q) 5h, G) . 
where h: m—> A(G) is the mapping making G a z-module. Consider then: 


Ps - 
1) Il) Wr) XE (Gg) > F (4,4) 


where p is the projection onto the second factor. It is equivariant so (7.13) 


induces: 

p* pa" 
H1(Lx(G, q) 3h, G) ——> H8 (W (x) X K(G,q)) —— HK (G, q); @) 
The fundamental class (cf. [4]) of He(K(G,g);@) is in fact oe 
Let us denote it by u, then we define 


Us € Hı (L: (G, q) 3h, G) 
by 
(7.14) Uo = (p*) *pa*uo. 


We define now t: K(G,p) > Ls(G,q) by 

(7.15) van) = [(#0")1, zu] 

where £, € K (G, gq)» and (8")1 is the n-th fold iteration of the 0-th degeneracy 

applied to the unit of m. + is one-one into and will be referred to as the 

inclusion of K(G,q) in Le(G,q). For any local group (h’, @’), 4 induces: 
#*: H* (L(G, 9) 5h’, @) > H*(K(G,q) 5) 

Now it follows that 

(7.16) FU o = Up. 


7.17. Let X, Y be one-vertexed complexes, « a homomorphism : 
”.(X)>m(Y) then by za(X,¥) we denote the set of homotopy classes of 
mappings with base point fixed, which induce « on the fundamental groups. 

We have now a classification theorem: 
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2.18. THEOREM. Let (X,a)€ L=, then the function which to every 
$€ wa(X; Le(G,q)) assigns ¢*U, in Hı(X;ha,G) establishes a one-to-one 
corerspondence between 

na(X, Le (G, ¢)) 
and 

Ha(X;ha, G). 


(7.18) is a special case of a theorem of P. Olum [14]. It permits us to 
deduce just as in the case of ordinary coefficients the following : 


7.19 THEOREM. The function which to every TE Öz(h,G,q;h’,G’,n) 
associates T(Ln(G,q),1)U.€ H*(L(G,q); k, @) establishes a one-to-one 
corerspondence between Ox(h, G,q;h’, G’,n) and H*(La(G,q) 3’, @). 


The role of + to link the groups G and @ as far as cohomology operations 
are concerned is made clearer by the following: 


7.20 THEOREM. Let ve H"(Le(G,q) 3h’, @’) come from H"(K (m,1); 
h’,@’) under the projection L«(d,g)>K(m,1). Then the cohomology 
operation T, uniquely associated to u by (7.19) is constant, i.e. for any 
(X,a) € Lx and any pair of classes x,y € H(X ; he, G) 


Ty (2) =Ty(y). 
The proofs of (7.18), (7.19) and (7.20) will be given in Section 10. 


7.21. In Chapter II we defined reduced powers with local coefficients 
and singular theory. We may extend the definition of the Pt to Kan com- 
plexes as follows: 


Tf X is a Kan complex, let |X | daie the geometric realization of X 
in the sense of Milnor [11] and 8 |X] the total a Lin complex of | X |. 
Milnor defines a homotopy equivalence: 


kx: X38 |X| 
which is functorial with respect to s.s. mappings. Choose a base point To 


in X, then kr: m (X,%) Swi (S| X|,kx(o)), and if G is a local group 
at to, we may consider G, as a local group at kr(z,) and then ky induces: 


kx*: H*(8 |X|; Go) > H*(X; Go) 
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If now X is an one-vertexed (Kan) complex, G a local group, at the base 
point, which is cyclic of order p; define 


Pt: HX; G4) > Hee yx; G) 
by: 
(7.22) Pur Ptkrtu 


then it easily follows that the Pt satisfy the properties of (5.6) and we have: 


7.23. The reduced powers {P+} are a sequence of cohomology operations 
defined in the category Laz. For every pair of integers i and q and any 
cyclic group G of order p, they give rise to an operation P*E Gaz, (G, q; 
Q, q + 24(p—1)) where A(Z,) operates in G via a fixed isomorphism G = Zp. 


8. Operations with initial and terminal (local) coefficients cyclic 
groups of order p. 


8.1. Notations. In this section r will denote the automorphism group 
A(Z,) of the integers mod p, and G will denote Zp; @’ will denote a cyclic 
group of order p(p-prime > 2) and 6@+(G,q;G’,n) will denote the set of 
cohomology operations with initial coefficient group @ on which m operates with 
the standard action, while @’ is the terminal coefficient group on which ~ 
acts via a fixed isomorphism @ — G. 

For every space X we have defined a group $,(X) (see §2) of local 
coefficient systems with basic group cyclic of order p, and H*(X;9,) stands 
for the bigraded vector space over Z, with bidegrees (q, 9’) where q is a 
non-negative integer and 8’€ 3,(X). 

The main result in this section (see (8.5)) asserts that H*(Le(G, q) 3.9) 
is naturally isomorphic to H*(K(G,q);@). Cartan [4] has given a com- 
plete description of the cohomology of H*(K(G,q);G@). Easy consequences 
of this are then (5.6), a characterization of reduced powers with local coeffi- 
cients, and a system of generators for operations with initial and terminal 
groups @ and @ respectively. 


8.2. We begin by recalling the structure of H*(K(G,q);G@) as given 
by Cartan. A sequence I= (a,° ` ',@,) of integers is called an admissible 
sequence of height q and stable degree q(Z) if: 


1) a,==0,1 mod 2(p—1) 
2) a= pain 
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3) Ya=¢(L) 
and 


4) pa <(p—i)(q+¢(Z)). 


To every admissible sequence I of height q we associate an operation St! as 
follows: 


By (1) yeRk(p—1) + 6 where e=0,1. If e,—0, set Ste PH, 
and if g—1 set Str — PQ. Then 


St! State. - - Stan 
corresponds to the admissible sequence J. 


8.3 Teeorem (Cartan). The cohomology ring H*(K(G,q);@) wa 
tensor product of exterior and polynomial algebras on one generator. The 
generators of these algebras are Stlu,, where u, is the fundamental class of 
K(G,q) and I ranges over all admissible sequences of height q. If Stu, is 
even (odd) dimensional, it generates a polynomial (exterior) algebra. 


The proof of (8.3) can be found in [4]. The system of algebra gen- 
erators in (8.3) will be referred to as the Cartan generators of H*(K(G, q); @). 


8.4. Now let us look at Lr(@,g). $p(Lx(G,q)) is cyclic of order 
p— 1, and a generator for this group is the class & of local groups with 
representative the local group G and standard action of + on G. Let &/ be 
the j-fold product of $. 

Since K(@,g) is simply connected if q > 1, $,(K(G,q)) reduces to G, 
and the inclusion : 


t: K(G,q) > L(G, q) 
of (7.15) induces by (2.5) a ring homomorphism : 
i*: H*(Le(G, q); $p) > H*(K(G,4); G) 


with 1U. =tio, where U, is the fundamental class of Le(G,q) and u, that 
of K(G,q). e 


By the degree of a monomial on the Cartan generators we will mean the 
number of factors in the monomial. 


Now we can state our main theorem: 
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8.5. Let i: K(G,q) > Lx(G,¢q) be the inclusion, then i induces a ring 
isomorphism : . 
i*: H* (Lx (G,q) 39») > H*(K (0,9) ;@) 
with 
t*U = Up. 

Furthermore for every j,1* sends H*(Lr(G, q); $1) isomorphically onto 
a vector subspace V; of H*(K (G, q); Q); a basis for V, consists of all those 
monomials in the Cartan generators of degree k, where k= j mod p—1. 
A consequence of (8.3) and (8.5) is: 


8.6. The set of cohomology operations in £r with initial group G, 
and terminal group @’ (then action of m in @ being arbitrary) has a system 
of generators which consists of: addition, cup products, Bockstein homo- 
morphisms and reduced powers P+. 


We also have: 


8.7. UNIQUENESS THEOREM. There ts only one set of cohomology 
operations with initial and terminal local systems with basic group a cyclic 
group of order p, which reduces to the ordinary Pt. 


Chapter IV. 
The Proofs. 
9. The proofs of Chapter II. 


9.1. The proof of (4.2) and (4.3). As we mentioned earlier we use 
the acyclic models of Hilenberg-MacLane. For the main theorem and concepts 
we refer to [8]. 

Let X denote the category whose objects are pairs (X,p) as in (4.3). 
Let #G, denote category whose objects are pairs (A,p) where A is a (free) 
chain complex, p a group acting as automorphisms of A. A mapping 
g: (A,p) > (B,o) is a chain mapping A>B and a homomorphism po 
both denoted by g such that: 


g (8a) == g (8)g (a) 


We consider the following models M in W, (Ag,1) g==0,1,:- - where 1 is 
the group of one element. 
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Let 7 be a permutation group on p symbols (p a prime > 2) and Wa 
fixed w-free acyclic chain complex. 
Define two functors K, L: %— 6G, as follows: 


(9.2) K(X, p) = (W@C,(X), 7 Xp) 


where C,(X) are the integral singular chains on X, and «Xp acts in 
W&0,(X) diagonally. 

I f:(X,p) > (¥,c0) then F(f): K(X,p)>K(¥,c) is the pair 
(1@fy,1 Xf). 

Now 


(9.3) L(X,p) = ([C4 (X) ]?, r X p) 


where [C,(X)]? is the p-fold tensor product of C4 (X) with itself and r X p 
operates in [C,(X) ]? by: 


(7,5) (41 @> + -@ ey) =e (st) Q: Ola) @ (say) 8- - -@ (sap) 


where e = (—1)dime:dimaix if r ig the simple interchange of the i-th and 
(1+ 1) factors and s is any element of p. 

If f: (X,p)> (¥,0), then L(f): L(X,p)>L(Y,o) is the pair 
((f#)%,1 XF). 

Let ©, denote the category of pairs (A,p) where p is a group, A a 
p-module. Define 

Kpa: > Gy 
by 
KK) = (W58 Ca (Z), 2 X p) 


and an associated functor (cf. [8]): 
Êa: A> G, 


where palz, p) is the m X p-free module generated by pairs (u, m) where 
u: (Agp 1)—>(X,p) is a mapping in Y and mE Ky ¢(Ag1). We have a 
natural transformation of functors: 


©: Kya Kpa 


defined by ®(X, p) (u, m) — Kpa (u) (m). 
Construct now: 
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B: Rigo Kpa 


by 
E(X, p) (w8 2) == (w8 Ag u) 


defined in the v X p-basis of K,,(X). wu: (Ag, 1)—> (X,p) is the unique 
mapping taking the g-chain A, into z. ' 

It is easy to see that & is a natural transformation and that ®X = identity: 
Boa Kpa Define now: E= > > Kee, k,=-> Ey. and extend ® and &. 


r+3=; 


The functor Z is acyclic on models. For we can produce a contracting 
homotopy 


S: On (Ag) > Csr (Ag) 


and obtain a contracting homotopy for [C,(A,)]*, which we will still denote 
by s. 
Let Lg: A—> G* be defined by Lg(X, p) = {z € (Cy(X))? of dimension q}. 
Then: 
ds + did: Ln(Ag, 1) > Dy (Ag, 1) 
Now consider : 
ho: Ky Ly 


defined by ho(X, p) (to @%q) =28: - -Q To if wo, To are vertices of W and 

X, and extend hy by linearity to K,(X,p). 

We may now apply Theorem II of [8] to obtain an extension of ho 
which is the required ¢’ of (4.2) which satisfies (4.3). 


9.2. Proof of (4.16). 


By (4.15) the operation 8* is natural, hence reduces to the ordinary 
Bockstein when the coefficient system is simple. Also it is a cohomology 
operation in Oa z,)(Zp,9,Zp,9-+1), hence to prove (4.16) it suffices to do 
it in the universal example. With the notation of (8.5) and (4.16): 


i*( (846) To—B* (E(Uo)) = (Bae) o—B* (E(u). 
Now in [19] it is shown that the right hand side is 0. 
Then (4.16) follows by (8.5). 
9.3. Proof of (5.6), parts (2) to (5). 


i) (2) to (4) are proved in the same way as (4.16), namely the Pi are 
natural by (5.6) (1), hence it suffices to prove the assertions for the uni- 
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versal example. In [19] it is shown that the corersponding formulas hold 
for simple coefficients. Then (8.5) shows the same is true for local coefficients. 
ii) We prove (5) directly: 


Let (X,Y) be a pair, $ € 9,(X), i: Y>X and j: YX (X,Y) the 
inclusions then we have an exact sequence: 


(9.4) H(X; b) ——> H(X, Y; 8) 
jt i* 
— Hex; §) ——> Aw (Y; $) 
and we want to prove: 
(9.5) P tõu = SP tu 
for every u€ Ha(Y ;i*G). 


We reduce the proof of (9.5) by a sequence of transformations: 
fı fe 2 


Army 5 & xu Freien 


where we need to define the new terms and mappings. J is the unit interval 
İ == {0,1} its end points and X—-XU(¥ XI). fı is the inclusion; it 
induces a natural isomorphism of the exact sequences (9.4). fə is the 
inclusion and since F X 1 is a deformation retract of Y X I, fs induces an 
isomorphism of the cohomology sequences (9.4). fa is the inclusion and it 
induces an epimorphism : l 


(9.6) fet: H*(XU (¥ X1); 48)—>H*(Y X1; 9). 


Finally f, is an excision, hence also induces an isomorphism of the exact 
sequence (9.4). 

By naturality of the P+ it suffices to prove (9.5) for the pair (X, Y <1). 
Assume (9.5) holds for the pair (Y XI,Y X 1), then it also holds for 
(¥,XU (¥ X1)). Since the P? are natural, $ commutes with f,*, and fs* 
in (9.6) is onto, one readily proves that the Pt commute with ô of the pair 
(X,Y X1). Since f.* and fı* are isomorphisms, it follows that (9.5) holds 
for (X,Y). 

Hence it remains to see that (9.5) holds for the pair (¥ XI,¥ x1). 
Let $ € $,(X), &’ the induced system in Y X I and consider 
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ô 
HY X l; 8’) —> He'-(Y X LY X1; 9’) 


Ha(Y X 1) consists of two copies of H«(Y'), obtained by crossing with the 
generator of the 0-cohomology groups of the end points of I. Let a and å, 
be the respective generators. Thus if u€ H7(Y), u gives rise to two elements 
in H9(¥ X1),uX & andu X a. Let J’ denote the generator of H'(I,1;Z,), 
then if we He(¥;%), ux Ve Am (Y XI, EX1; 9’) and it is shown in 
[13] that: 
S(u Xü) = e(u,t)u x I’ 
where «(u,t) = (—1)4im*+4, Hence 


Pt (u dX dy) = 8( P tu X å) = e(u,1) Pu x I’ 
= e(u, 4) Pi (u x I’) == Pt (uX &) 


by parts (2), (3) of (5.6) together with formula (4) for cross-products. 


10. The proofs of Chapter III. 


10.1. Proof of (7.18). We sketch a proof of (7.18) by passing to the 
universal covering spaces. Consider then the diagram: 


za (X, Le (G,q) ———> wa(X, W(m) X K(@,q)) 
(10.2) m r(Ž,K(@,4)) 


p* 
A(X; ha, Q) —— Ha (X; Q) 
1) re(X, L(G, q)) is the set of homotopy classes of mappings with 


base point fixed, inducing « on the fundamental groups. 


2) ml, W(x) x K(G, q)) is the set of homotopy classes of mappings 
with base point fixed which are a-equivariant, i.e. satisfy 


fs = a(s)f 
for any s € m, (Z). 


3) ral, K (G, q)) is the set of a-equivariant homotopy classes with 
base point fixed. 
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The mappings of (10.2) are defined as follows: 


4) „(f) =f where f is defined in (7.6). vı passes to classes. 

5) ve(7) = pf, where po: W(x) XK K(G,q) > K(G,q) is the x-equi- 
variant projection onto the second factor. 

6) m(f)= Fun. 

7) m(f) = fU.. 
From the definition of u, and Uo, it is easily seen that 


q = P* nevevs- 


Now p* is an isomorphism, and it is not hard to see that v, is a 1-1 corres- 
pondence. As to v» we have the following commutative diagram: 


ral E, W(x) XE (G,q)) ——> re(¥,K(G,q)) 
i ty 
_ Da 2 
a(X,W (m) X K(G,q)) ——Hr(X,K(@,g)) 


where #(X,W(r) X K(G,q)) and +(X,K(G,q)) are the sets of homotopy 
classes of mappings with base point fixed. So i and i are 1-1 into, while pe 
is a 1-1 correspondence, since W(x) is contractible over itself holding the 
baset point fixed. Now vs is onto; for let [f] €me(X,K(G,q)) and let. 
ga: Ž —> W(x) be the unique a-equivariant homotopy class (with base point. 
fixed), then setting 

f= (ga, f) ie. 


P(t) = (ga (2), F (2) ) 


then f! E wa(X, W (r) X K(G,q)) and v[f] = [F]. 

Finally m2. is a 1-1 correspondence, since the proof Cartan [4] gives of 
the 1-1 correspondence between 7(X,K(G,q)) and H(X;G), shows that. 
a-equivariant mappings correspond to a-equivariant cohomology classes. 


10.3. Proof of (7.19). 

Let T be a cohomology operation in @«(h, G,p;h’, G’,n), then T(Uo) 
is an element of Hr(ZL+(G,g);h’,@’). Conversely given u€ H”(Lr(G, q); 
h’, Œ) define a function 


Ta: Hı( 34,4) > H"( 3h’, Œ) 
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in £r as follows: If ve H(X; ha, G), let ¢, denote the unique homotopy 
class in ra(X, Le(G,q)) which corresponds to x by (7.18), define T,(z) 
= ġ* (u). Ta is natural, for if f:(¥,8)— (Z,e) is a mapping in £r, 
ve HY(X,ha;G) then f*xe Hı(Y;hß,G@) and if $» is as above, then ¢af 
corresponds to f*z, so 


- Ty (fF) = f*pa* (u) = f* (Tu (2)). 


Hence Tu is a cohomology operation. Moreover it is clear that the corres- 
pondences T—>T(U,) and u-—>T, are inverses of each other, but this is 
(7.19). 


10.4. Proof of (7.20). The hypothesis of (7.20) give us a diagram 


x 5 ie(G,9) Fee n) 


Aa 


K(m,1) 


in which the triangle is commutative up to homotopy. Here ¢, and ¢, 
are the homotopy classes corresponding to u and v according to (7.18). 
The definition of T,(z) for a class ze H1(X;ha,G) of (10.3) uses 
fo € ral X, Lx (G,q)) but {pos} = {poy} for any x,y € Ha(X ; ha, G), hence 
(7.20). 


10.5. Proof of (8.5). Recall that Lx(G,g) was obtained from 
W(a) x K(G,q) by collapsing under the action of r; let 


p: We) X E(G,q) > Lr(G, q) 
be the natural projection and consider the following sequence: 


p* 
H* (Ix(0,9) 5h’, @) —>H*(W (m) X K (0,9); C) 
4% 
Pes 


P: 
H*(K(G, 4); P) ——> H*(W (1) XE (G, 4); @) 


where #* is induced by the inclusion of cochains, p.* is induced by the pro- 
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jection onto the second factor, p* is an isomorphism by (7.7). p.* is a 
r-isomorphism, since W (r) is acyclic and po is -equivariant. 

Under the hypothesis of (8.5), m is a cyclic group of order p—1, @ a 
cyclic group of order p, hence we may apply (3.6) to conclude that i is a 
monomorphism, its image being H*(W (r) X K(G,q); @’)*, we thus obtain 
an isomorphism : 


(10. 6) p: H*(Le(G,q) 5h’, 6) > H*(K(G,q) 3 @)* 
where B = pio*-4*p*. 

Now as in Section 2 we are interested in the equivalence class of local 
systems containing (h’,G’), hence we may assume that (h’,@’) == 8° (for 
some value of j < p—1) the j-fold product of the generating class of $,(X) 
whose representative is G=Z, with standard action of A (Zp) =z. 

We may take as representative of &°, G with action of 7 defined as 
follows: 

(10. 7) s*g == gis g 

where gE G, 3€a. Thus (10.6) reduces to: 

(10.8) Bj: H*(Lr(@,g) 5h, @’) > H* (K (G, q); @)* 

where the action of + in the coefficient group G is that given in (10.7). 
Let us say that r operates in H*(K(G,q);G) according to &, if it operates 
with the standard action in K(G,q) and according to (10.7) in the coefficient 
group. Now we have: 


10.9. Lemara. The subspace Vy of pointwise fixed elements of 
H*(K(G,q);@) under the gy-action of m, has a basis consisting of all 
monomtals in the Cartan generator of degree r, where r is congruent to 
jmod (p— 1). 


Proof. For any s€ m, let ,(s) be the automorphism of H*(K(G, q) ; G) 
induced by the automorphism of the coefficient group @ given by: 


eg 


and let y, be the automorphism of H*(K(G,g);@) induced by the action 
of sin K(@,g), but assuming trivial action on the coefficient group. 
We now claim: 


(10.10) bi(8)€ =— ((8) pe) T 
for any ze H*(K(G,q);G). 
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lt suffices to verify (10.10) in the cochain level. Let uc C*(K(G,q);G@) 
then: 
(65(8)¥) (o) = stu (sto) = (y (s)ysu) (0) 


for any n-simplex o of K(G,q). 

Now let T be a generator of m corresponding to a ae root k of p, 
ie T: G—>G@ is given by T(1) =k. 

We determine now the automorphism yr of H*(K(G,g);@) using the: 
structure of H*(K(G,q);@). 

Let zo be the fundamental g-cocycle of K(G,p), then Tz) =k 2, hence- 
passing to cohomology we obtain: 


(10.11) Tuy = kuo. 


But from (8.3) u, generates H*(K(G,q) ;@) by cohomology operations ;. 
since yr is natural, this enables us to determine yr in H*(K(G,q);G). One- 
readily verifies that: 


(10.12) Wr (mr) = km, 


for any monomial m, on the Cartan generators of degree r. 


Since ¢;(s) is a coefficient automorphism, we see that ,(T) (x) = kiz 
for any ze H*(K(G,q);G@). Combining this with (10.12) and (10.10),. 
we obtain: 


(10.13) HT) (m,) = km, 
and since k is a primitive root of p, 
p(T) (my) =m, 
if and only if r—j=0 mod (p— 1). 
Thus m, is pointwise fixed under the ¢,action of + if and only if 
= j mod (p— 1) where r= degree m,. 
Suppose now z€ H*(K (G, q); @) is pointwise fixed under the ¢;-action. 


of +. Relative to the basis of H*(K(G,q);G@) consisting of monomials in 
the Cartan generators, x has a representation: 


t= Samy, 


where ntn, is a monomial in the Cartan generator of degree 7; and dimension 
that of x. Then: 
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p(T) (2) = D aip (T) mr = X am, 


but by the uniqueness of the representation of z in terms of the basis, it 
follows that $,(T)(m,,) = m,,, and by the above this implies 1;== 7 mod (p — 1). 
This finishes the proof of (10.9). 


10.14. COROLLARY. For 1Sjsrp—l, 
Bj : H*(Le(@,q) ; 81) > H*(K(G,q) 54. 
(where Bj is as in (10.8)) is a monomorphism onto Vj; Vi N Vy =Ù tf and 
only if 754k, and 5 Vj H*(K (6,9) $4). 
Now by (2.4) i*: H*(Lx(G, q) ; $2) > H*(K(G, q); @) is a ring homo- 


morphism and (10.14) shows it is in fact a ring isomorphism. (10.9) tells 
us the structure of H*(L(@,9);@’) and thus (8.5) is complete. 


PRINCETON UNIVERSITY AND 
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ON THE DEFORMATIONS OF LATTICE IN A LIE GROUP.* 


By Hsten-Cuune Wane.! 


1. Introduction. By a lattice in a topological group G, we shall always 
mean a discrete subgroup T of @ with G/T compact. Suppose T, to be a 
fixed lattice in G, and ro: To—> G the identity map. Let R (Ta, Œ) denote 
the space, with the compact-open topology, .of all the isomorphisms r: To -> G 
such that r(T,) are lattices in G, and R,(T,,@) the connected component 
of (To, G) which contains the identity map ro. Since 01(To, G) is arc- 
wise connected, each element r of œ, (Do, @) will be called a deformation of Ty. 
Those deformations which are obtained by applying automorphisms of @ to 
To will be called trivial. When G is a compact or a nilpotent Lie group, 
it follows directly from some results of Montgomery-Zippin [11] and Malcev 
[9] that all the deformations of lattices in @ are trivial. A. Selberg [13] 
and Calabi-Vesentini [6] have proved the triviality of deformation of lattices 
in certain simple Lie groups. Recently A. Weil has established some general 
properties of the space R (To, @) for an arbitrary Lie group G [14], and also 
determined completely ®,(T., G) when G is semi-simple and has no compact 
factor [15]. 

Now assume that @ is a connected and simply-connected Lie group whose 
semi-simple part has no compact factor. It is the aim of the present paper 
to give a description of the space R,(T,,@). We write G as a direct G, X G 
where G, is semi-simple and G, has no connected simple normal subgroup. 
Let R be the radical of Ga, S a semi-simple part of G, and N the maximal: 
connected nilpotent normal subgroup of R. Denote by m: G> G, (t—1,2) 
the projections. Then 7,(Io) is a lattice in G, and so Rı(m(T,),G,) has a 
meaning. Our main results can be stated as follows: 


(A) Let A, denote the e-component of the group of automorphisms of 
the group T,N with the compact-open topology, and AdgS the group of 
all inner automorphisms of G induced by elements in S. Then, to each 
rE Rı(To, G), there esist r,€ R1(m(To),G:), c€ AdgS, a€ Ay such that 
r(y) — (rem (y), m0a(y)), yE To. 


* Received July 17, 1962. 


1 Guggenheim Fellow and supported in part by National Science Foundation NSF- 
G-19079. 


189 


190 HSIEN-OHUNG WANG. 


(B) The map (r,,0,a)—r as defined in (A) is a covering map of 
®R.(41(To), Gi) X Ade S X Ap R1i(To, G) with finite covering group. 

Since @, is semi-simple without compact factor, the space R, (mı (Ts), G1) 
is completely known [15], and so the above theorems give a description of 
the space R,(To G) in terms of the two groups of automorphisms Ada S 
and As As a Corollary, we have 


(C) If Gis solvable, then the deformations of T, in G are in one-to-one 
correspondence with the elments in the e-component of the group of auto- 
morphisms of the non-connected Lie group TN. 


2. Some properties of nilpotent Lie groups. Let N be a connected 
- and simply-connected nilpotent Lie group. It possesses many particular 
properties of the real vector space when considered as a group. In this section, 
we shall give some such properties which will be used later. 

Suppose that f is an automorphism of N and py: N—>N is defined by 
pr(2) =f (£), ve N. We shall call f unipotent if p"(N)=e for some 
integer m > 0 where e denotes the identity. 


(2.1) An automorphism f of N is unipotent if and only if the auto- 
morphism of the Lie algebra N of N induced by f is unipotent. 


Proof. When N is abelian, this is evident. For the general case, this 
can be verified directly by using induction on the length of the lower central 
series of N. 


(2.2) Let f be an automorphism of a nilpotent Lie algebra N. If 
it is unipotent mod [N,N] (ie, there exists an integer m such that 
(f—1)"N C [N,N]), then it is unipotent. 


Proof. We shall prove it by induction. Suppose that (2.2) is valid for 
nilpotent Lie algebras of dimension less that that of N. Let 
NO—N, NO—[N, Nev], Sem 1, 2,850 * 


and ¢ the largest integer for which N40, Denote by N* the quotient 
N/N®, m: N-» N* the projection, and f* the automorphism of N* induced 
by f. By assumption (—1)"N C [N,N] and so 

(f#—1)™N* c [N®*,N®]. 
This tells us that f* is unipotent mod [N*, N*]. It follows from the induction 
hypothesis that f* is unipotent. There exists then an integer n such that 
(f—-1)#¥ Cc NO), 

Let a,y¢ N. Using the fact 
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(f—1) [ey] = [(f—1)2, (fF—1)y] + (¢—1)2, 9] + [es (fF —1) yg], 
we can easily verify that, for any positive integer k, (f—1)*[ x,y] is a linear 
‚combination of elements of the form 


LED, (F—1)'9], 0SqrShsqtrZh. 


It follows that 
| (fF—1)*[2, y] € [VO, Ñ] = 0 
and hence z a 
(F—1)™= (N) C (f—1)”[N, N] =0. 


The unipotency of f is thus proved. 


(2.3) Let © be a lattice in N and f an automorphism of N leaving © 
invariant. Suppose that p” (©) =e for some integer m where py is defined 
by py(z) =fle)rt. Then f is unipotent. 


Proof. Let N* == N/[N, N], m: N— N? be the projection, ©* =r (0), 
and f* the automorphism of N* induced by f. Then ®* is a lattice in N*[9] 
and pr”"(®*) =e. But N* is isomorphic with a vector space and so f* must 
be unipotent. In other words, f is unipotent mod [N,N]. Proposition (2.3) 
then follows directly from (2.1) and (2.2). 


3. Some known results. For the sake of clarity, let us list in this 
section some relevant known results. Suppose @ to be a topological group. 
A subgroup H of Œ will be said to have the Selberg property, or simply 
property (8), if for any neighborhood U of the identity e in @ and every 
element g of @, there exists an integer n > 0 with gre UHU [4]. As shown 
by Selberg [13], every lattice has the property (8). 


(3.1) (A. Selberg; A. Borel). Let G be a semi-simple Lie group 
without compact factor, and H a subgroup of G with the property (8). For 
any linear representation p of G, every invariant subspace of p(H) is invariant 
under p(@) [4]. 


As a consequence of this, we have 


(3.2) Let G, H have the same meaning as in (3.1). Any normal 
solvable subgroup L of H belongs to the center of G. 


Proof. Choose an irreducible representation p of @ over a complex 
vector space V such that the kernel of p coincides with the center of G. Such 
a p always exists. If p(L) 1 then (3.2) is proved. If otherwise, let 
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p(L) =Q.7 Q2 aD: ae 


be the derived series of p(Z) and let # be the largest integer for which Q; #1. 
Since Q: is abelian, it has a non-trivial weight space V¢, i.e. & is a character 
of Q; and 

Vo {2€ V: g(t) =4$(9)2,9€ Qi} 0. 


-The number of such weight spaces is finite. Since p(H) permutes these weight 
spaces, so does p(G@). But G is connected. Hence p(@) (Ve) =T, V = V9, 
and Q; contains only scalar matrices. From our choice of p, Q;—=1. (3.2) is 
proved. 


(3.3) (L. Auslander [2], H. Zassenhaus [16]). Let G be a connected 
‘Ine group with simply-connected radical R, m: G> @/R the projection, and 
L a closed subgroup of G. If the e-component of L is solvable, then the 
e-component of the closure #(L) of x(L) is also solvable. 


(3.4) (L. Auslander [2]). Det G be a connected, simply-connected Lie 
group, R its radical, C the maximal connected normal compact subgroup of a 
semisimple part of G, and x: G—>G/CR the projection. Suppose L to be a 
closed subgroup of G with its e-component solvable. If w(L) has the property 
(8) in G/CR, then a(L) is discrete. 


For application in Section 5, we need a generalized form (3.4) of a 
result of Auslander [2]: we do not assume L to be discrete. The proof is 
a refinement of the arguments in Auslander [2] and Zassenhaus [16]. How- 
ever, since [2] has not appeared yet except as mimeographed notes, for 
completeness we give the proofs in full in the appendix rather than just the 
modifications necessary to our form of the proposition. 


4. Lattices in the direct product of a semi-simple group and a vector 
space. As preparation for the general discussions, we shall consider lattices 
in a particular class of groups. Let T be a lattice in a direct product 
G == G, X G: where G, is a connected semi-simple Lie group without compact 
factor and G a vector space over the reals. As can be seen by examples, 
TN G, is not always a lattice in @,. For latter use, we shall establish some 
properties of T N G. 

Throughout this paper, for any real linear group L, we use Q (L) to 
denote the least real algebraic linear group which contains L. 


(4.1) Let r: =G, NT and Ty be the image of T under the projection 
mi: G—>G, (t-—1,2). Then Ty’, T, are lattices in G, Q, respectively, and 
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I, contains the commutator subgroup [T1’,T/]. For any linear representation 
p of Gy, p(G1) is the e-component of A(p(T})). 


Proof. The facts that T,’, T, are lattices in G,, Ga respectively follow 
directly from (8.4). Moreover since G, is abelian, we have [T,T] C Gy 
and so 

(Ty, Ty] =r ((P,P]) Cm (Ti) =r. 


Now let p be any representation of G,. Then p(T,’) is a subgroup of 
p(G,) having the property (S). Since p(G,) is semi-simple without compact 
factor, we have p(G,) C G(p(Ty’) [4, p. 187]. It follows then 


p(Gr) = [p(G:1), p(Gs)] C TAG), AEN] = A(p[Tv,Tx’]) C AM). 


But A((T,)) C A(r(G,)) and so Z(p(G,)) = G(p(P:)). Therefore p(@,) must 
be the e-component of G(p(T1)). (4.1) is thus proved. 


(4:2) Suppose that there exists a locally one-to-one representation 
p: G>GL(R,r) such that p(T) contains only matrices with rational integers 
as entries. Then T, is a lattice in G1, or what is the same, Ts’ ts discrete. 


Proof. Let M—p(@), Mi p(G,) and let M., Mz be respectively the 
sets of all integer matrices in M, M,. Denote by Q the normalizer of M,, in 
M.. Since M, is a normal subgroup of M, Q must be invariant under Ad M, 
and so QM, forms a group. Let us first show that QM, is discrete. From 
(4.1), @(M,) =Q (p(T:ı)). But p(T,) contains only integer matrices. It 
follows that @(p(T,)), and hence Q (M), is a real algebraic linear group 
defined over the field of rational numbers. Since M, is semi-simple, Q(M,)/Mı 
is finite and therefore M,/M,, has a finite invariant measure [5]. Taking 
account of the results in [4], we see immediately that O/H, is finite. There- 
fore QM,/M, is also finite. Since W, is discrete, QM, is also discrete. 

Let y be an element of T. It takes the form y= 2,7, where 


Uy == T1 (y) € G, Lo = mo (y) € G. 
Since p(y) is an integer matrix, we have 
p (21) Miep (21) * = p (y) Mise (y) = Mae. 


This tells us that p(x:(y))€@ for yET, or what is the same p(T’) C Q. 
It follows that 


p(T) C p(Ty’-T) CT) C OM, 
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whence p(Ty’) is discrete. By assumption, p is locally one-to-one and: so Ty’. 
must be discrete. (4.2) is thus proved. 


5. Projections of lattices. Let G be a connected and simply-connected 
Lie group, R its radical, and N the maximal connected nilpotent normal sub- 
group of R. Then @ takes the form of a direct product G = G, X G, where 
G, is semi-simple and G, has no connected semi-simple normal subgroup. 
On account of the simply-connectedness, G is the semi-direct product SR 
where $ is semi-simple. We note that S acts almost effectively on R under 
the adjoint action. Moreover [7, p. 109], l 


[G,R] CN, [@,@] C GSN. l 
By using these inclusions, we can verify the following without diffculty : 
(5.1) (a) G/-N=G,XSXR/N. (b) Let Z denote the center of N, 


and y the linear adjoint representation of G on the Lie algebra N of N. Then ` 
the mapping S—>7(S) is a local isomorphism, and the e-component of the 
kernel of nis Gy X Z. 


After all these preliminaries, we are now in the position to prove a 
theorem 


(5.2) Txmormm. Suppose that G, Œ, Ga S, R, N have the same 
meaning as above. Let T be a lattice in G and 


p: Q> G/B, £: ha> Q/R, m: GG, (t—1,2) 


be the projections. If the semi-simple part of G has no compact factor, then 
(i) the e-component of ma(T) belongs to the center of N, and (ii) the image 
of T under the following projections are all discrete: 


G—>G/GR (Z8), G> G, G> G/G,8N (= B/N). 


Proof. From (3.4), #(T) is discrete and hence RMT is a lattice in R. 
A theorem of Mostow [12] then asserts that © == N N (TN R) =rNN isa 
lattice in N whence the image of T under the projection @—> G/N is discrete. 
With these in mind, let us discuss 7,(I') which is, in general, non-discrete. 
Denote by 7 the linear adjoint representation Ady of G over the Lie algebra 
N of N. Then | 


„(F) = (r) =q (x: (1)), g(r(T)) C (FP). 
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The subgroup ® is a lattice in N, and y@y'=@ for all y€ T. From Malcev’s 
results [9], there exists a base of N referred to’ which „(T) contains only 
_ integer matrices, and hence 7(I) is discrete. Therefore n(r:(T)) must be 
discrete and the e-component of ma(T} belongs to the kernel of y. From (5.1) 
it follows that the e-component of (T) is contained in the center Z of N. 
’ (i) is thus proved. Applying (3.4) with ma (T) taking the place of L, we 
see directly that £(m(T)), and hence &r,(T), is discrete. In other words, 
the image of T under the projection G> G/G,R (= 8) is discrete. 

Let A = p(T) and let us identify G/R with G, X S. We already know 
that A is a lattice in G, X S and its projection in 8 (which coincides with. 
€rs(T)) is discrete. Since both G, and S are semi-simple without compact 
factor, a result of Weil [15] asserts that the projection of A in the other 
factor G, must be also discrete. We note that this projection of A in G, 
is nothing but the image of F under the map G> G/SR (= Gh). 

Now it remains only to show the discreteneas of the image of T under 
the projection G> G/G,SN (—R/N). For this purpose, let N* = N/[N, N]. 
Since N is connected and simply-connected, N* is a vector space over the 
reals. For any g€ G, gNg?==N, g[N, N]g?—= [N,N], and so g induces an 
automorphism 7*(g) of N*. We have thus a linear representation y* of G 
over N*. Let @* be the image of ®=N MT under the natural map N> N*. 
From Malcev’s results [9], ®* is a lattice in N*. Since n*(y)@* = @*, yET, 
n*(T) is discrete. Let K be the kernel of y*. Applying (5.1) to @/[N,N], 
we can verify immediately that the e-component K, of K coincides with 
GX N. Therefore n* can be written as the composite of the following two 
homomorphisms : 





y: G>G/K,(=SXR/N), f: G/K. > 9*(G). 


(We note here that „*(@) may have weaker topology than G/K, but is anyway 
a 1-1 homomorphic image of G/K). Evidently v(T) C f-*y*(T). Since both 
n*(T) and the kernel of f are discrete, y(T) must be also discrete, and hence 
a lattice in G/K). 
Now we identify G/K, with S X R/N. y(T) is a lattice i in this product. 
n” induces a locally one-to-one representation p of S X R/N over the vector 
space N*. Since py(T)—=n*(T) contains only integer matrices, we know 
from (4.2) that the image of y(T) under the projection § X R/N>R/N 
is discrete. In other words, the image of T under the Den G— G/G,8N 
is discrete. This completes the proof. 


As an immediate consequence of (5.2), we have 
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(5.8) Let à: G98, m: GG, r: G>R/N be the natural projec- 
tions. Then, in each of the following pairs of groups, the former is a lattice 
in the latter: 


(A(T), 8), (m(T),G:), (r(P), B/N), (ARNT, GR), (NT, Gr), 
(GSN NT, GSN). 


6. Some density properties of F. Suppose that G, Ga, 9, R, N,T,--- 
have the same meaning as in Section 5, and assume that the semi-simple part 
of G has no compact factor. Let us recall that, for any real linear group, 
Q(L) denotes the least real algebraic linear group containing L. 


(6.1) Let p be a real linear representative of Q such that p(N) con- 
tains only unipotent matrices. Then p(G: X SN) C G(p(P)). 


Proof. Since N NT is a lattice in N, there exists a base X, °, X, of 
the Lie algebra N of N such that 


yi=expx,e NAT (i= 1, 2,- : 78): 


By assumption, p(expiX;) is unipotent for any real t and so A(p(yı)) 
— {p(exptX,): t= real}. It follows that 


(6.2) pe(N) C A(e(L)). 


Let à: @—> G/N be the projection and let us identify G/N and the 
product (G, X 8) X E/N. From Theorem (5.2), A(T) is a lattice in 
(GX 8) X B/N. Since (G, x8) is semi-simple without compact factor 
and R/N a vector group, we can apply (4.1), obtaining 


e(G: X 8) C A (P(A) N (G X 8)). 
Up to our identification, A is given by 


A(91) = 91, Als) = 8, Ar)—rN 
QE Qp SES, TER. 


It follows that A(T) N (G, XS) =IN N (@, XS) and therefore 
e(G: X 8) C A(p(TN)). 
Combining this with (6.2), we have 
e(G,SN) C A(p(TN)) = A(p(T)) 
and (6.1) is proved. 
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(6.3) Let a be an automorphism of G leaving T pointwise fixed. Then 
a leaves GL, X SN poiniwise fixed. 


Proof. Let & denote the automorphism of the Lie algebra G of G 
induced by & Since ¢-Ady=Ady-a for all yET, it follows from (6.1) 
that &- Ad g= Adg'& for all g€ G, x SN, whence g*a(g) belongs to the 
center C of G. We can easily verify that the map q: G, X S—> C defined by 
g(g)=gta(lg), g€ G XS, is a homomorphism. Since G, X89 is semi- 
simple and C abelian, q must be trivial, i.e., a(g) =g, ge (XS. On the 
other hand, rN N is a lattice in N and a leaves TN N pointwise fixed. It 
follows that a(n) =n for all ne N. (6.3) is proved. 


(6.4) CoRoLLARY. The e-component of ma(T) ‘belongs to the centralizer 
of SN in Gs. 


Proof. The intersection G, NT is a normal subgroup of T. It follows 


that Ga NT is a normal subgroup of »;(T), and hence, of m,(T). Therefore 
the e-component of z,(I) must centralize GaN T. But by Theorem (5.2), 
(T) is discrete and so NT is a lattice in Ga. Applying (6.3) with Ge 
taking the place of G, we know that the e-component of m,(T) must centralize 
SN. (6.4) ie thus proved. 





7. Stability of subgroups under deformation. Let I, be a fixed lattice 
in a Lie group G. Following Weil, we use œ (To, G@) to denote the space, 
with the compact-open topology, of all the isomorphisms *: T,— G such that 
r(To) is a lattice in G. The connected component of R (To, G) which contains 
the identity map ro: T'o —> G will be denoted by R(T., Œ). In fact, T, does 
not play any special role in R,(T,@). If we take re R,(T,@) and put 
T=r(T,), then R(T, G) = R (Do G). 


Definition. Let L be a closed subgroup of G, and T, a lattice in G. 
L is called stable under deformation of T, if the subgroup 1*(ZL) of Ty 
is independent of the choice of r in R,(T,,G). This condition is the same as 
(ToN L) mL Ar(lo), rE Rill, G). 

If L is normal and r: @— G/L denotes the projection, then we can see 
immediately that L is stable if and only if the kernel of ar: T,—> G/L does 
not depend on the choice of re R,(T,@). 


(7.1) If, for each re R(T., Œ), there is a neighborhood U of r in 


RılTo G) such that r3+(L) C s*(L) for all se Y, then L is stable under 
deformation of To. 
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Proof. Let r, be an arbitrary but fixed element in ®,(T,,@). From 
the assumption, we see easily that the set — 


Wem {1: rE Ri (To G) r (L) Crt(L)} 


is an open subset of R,(T,@). Since the condition r,+(L) C r>(L) is 
the same as rr,;7(L) CL, W must be closed, and hence 9 = R,(T,@). 
This tells us that r,*(Z) Cr*(L) for all re R,(T,@). But r, is arbi- 
trarily chosen, and so r!(L) ==2’*(L) for all r, VER.(T„@). (7.1) is 
thus proved. 


(7.2) Let L be a closed normal subgroup of G with G/L semi-simple 
and having no compact factor. If ar(T,) are discrete for all re R,(T,@) 
where m: G—>G/L denotes the projection, then L ts stable under the 
deformation of To. 


Proof. We find it convenient first to make two conventions. Let Q be 
a subset of G, and m a positive integer. The totality of commutators of the 
form : i 


[nlgl [gm m] Ih we 


will be denoted by £n(Q). By jim £(Q) =e, we mean that given any 
neighborhood U of e in G, there "exists an integer n such that Lm(Q) CU 
for mzn. 

Now let us prove (22). From N it suffices to show that each r 
has a neighborhood Y in R,(T,G@) such that r!(L) C st(L) for alse Y. 
For simplicity of notation and without loss of generality, we can take 1. to 
be ro. By assumption, @, =I, N L is a lattice in D. Hence it has a finite 
set of generators Bı, Ba’ ` -,Bs. Choose a neighborhood U, of e in G/L 
such that lim %,(U,) —e, and U, contains no central element of G/L 
except e. Such a U, always exists [16]. Let ee (Te) where r: G> G/L 
denotes the projection, and 


Ver {rE Ri (To G): Br (By) E U, imm 1,2, +, a}. 


This % is a neighborhood of r, in %ı (T,@). Let r be an arbitrary element 
in Y and F=={81, 8», > ', Ba}. Then w(r(B:)) € (BU) =27(U) =U, and 
hence 


fim Lu((F)) € ae £5 (U1) — 0, 


But „r(®,) is discrete and Lu (wr(F)) C ar(®). There exists then an 
integer n such that . 
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Euler (F)) =e. 


It follows [16] that the subgroup „r(®,) which is generated by »(F) must 
be nilpotent. Now we have the following situation: G/L is a semi-simple 
Lie group without compact factor; r(T,) is a lattice in G/L and ar (@p) 
is a nilpotent normal subgroup of »r(T,). From (8.2), zr(@,) belongs to 
the center of G/L. But U, does not contain any central element of G/L 
except the identity. It follows that mr(f;) =e and then ar(®)—e. In 
other words, r(®,) C L. Thus we have shown the existence of the neighbor- 
hood © of r, such that r!(L) D ©, =r (L) for all re Y. This proves our 
proposition (7.2). — 


(7.8) Suppose that G, Gu, Qa 8, R, N have the same meaning as in 
Section 5, T, is a lattice in G, and the semi-simple part of G has no compact 
factor. Then the subgroups N, R, SR, GB are stable under deformation of To. 


Proof. The fact that SR, GR are stable follows immediately from 
Theorem (5.2) and Proposition (7.2). Since R = SRN GR, R is also stable. 

On account of (7.1), to prove the stability of N, it suffices to find, for 
each r€ R,(T,,@), a neighborhood Y of r in Rı(To, Œ) such that 


m3(N) Cst(¥), sey. 


Since r, does not play any particular role in the set 01(To,G), it will be 
sufficient to construct the neighborhood Y for ro.. 

Choose a neighborhood U of e in G with the following properties: 
(i) to each z€ U, there corresponds a unique element X of the Lie algebra 
& of G such that exp X =z, exptX € U, OStS1; (ii) if zER, then X 
belongs to the Lie algebra Ê of R; (iii) if Ada is unipotent on the Lie 
algebra N of N, then Ad X is nilpotent on N. Let 1,82," : `, Ba be a set of 
generators of &, = N N To, and 


V— {re R (To, G) : Br*r (Bi) € U, 1=1,2,: g *, a}. 


This Y is a neighborhood of ro in R(T, G). Take rE V and put ® — r (N). 
Since N is a nilpotent normal subgroup of @, both @ and ®, are nilpotent 
normal subgroups of T,. There exists then an integer.m such that 


-[Bs [ Bs, E [Bi o]-- 1] 6 
Ma 


m 
whence 


[+ (8), r8) E > Er (8),r(8)1 + Ti] =e. 


m 
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By (5.2), r(@) =N Nr(T.) is a lattice in N, and so by (2.3) 
PD L(A), E: Tre) 0] “We 





m 


‘It follows then that, for each i, the subgroup M, generated by r(ß,) and 
- N is nilpotent. Since Ar'r(&)E M, the automorphism of N given by 
.@—> Brr(B:) ar (B;)*B, zE N is unipotent in the sense of Section 2. (2.1) 
then tells us that Ad B;*r(f,) is unipotent on N. 

By our choice of r, By*r(B,) €U. Let Y be the unique element of â 
with exp ¥—£;*r(8;) as given in the definition of U. Because of the 
property (ii), AdY is nilpotent on N. On the other hand, we already 
know that R is stable and so 


Ber (Bi) €N-r(N NOT) CN-r(RNT,) CNRR. 


‚From property (ii), Y must belong to the Lie algebra Êof R. But AdY is 
nilpotent on N and so YEN, Brtr(B)EN. It follows that r(Bi) EN, 
AN CN, or what is the same, l 


ro (N) =@ Crt(¥); red. 


This proves that N is stable under deformation of To.. The proof is thus 
completed. 
As an immediate consequence of en 2) and (i 8), 3 we have 


(2.4) Let 


m: @>R/N (=6/6,8N), X: G38 (—=G/GR), m: 43 5G" 
be the projections. Then ar (Ton GiSN), Ar(Ton GB) ba mit u NG) are 
trivial for al rER (To Œ). ; 


8. The projection s: G>R/N. It is the aim of this section to show 
that x(y)—=-r(y), yETo rE &.(To,G) where m: G>R/N denotes the 
projection. We shall first prove this for solvable G and then extend it to the 

l „general case. 


(8.1) ax For any semt- ae element AEGL(R,n), there exists a 
neighborhood U of the identity in GL(R,n) such that if BEU and tf BAB 
commutes with A, then AB=BA. (b) If A,BeGL(R,n) have the same 
semi-simple part and commute with each other; then A'B is unipotent. 


Proof. Part (a) has been proved by Frobenius [8]. To see Part (b), 
let Ay, By, be the unipotent parts of A, B respectively. Then ATB—=A,B,. 
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But Ay, B, are unipotent and commute with each other, and so Ay*B, is 
unipotent. 


(8.2) Let R be a connected, simply-connected solvable Lie group, N 
the maximal connected nilpotent normal subgroup and m: R>R/N the 
projection. For any lattice ® in R, r(y)=r(r(y)), yE Bo TE R,(®,R). 


Proof. Since the set {r E€ R,(®,R): r(y) =r(r(y)),yE Po} is closed 
in R,(&,R), it suffices to show that the identity map fo: ®,> Wf has a 
neighborhood Y) such that r(y) —=-ar(y), yE o TEV. 

Let y1,y2)° * `, Ya be a set of generators of &,. Choose a neighborhood 
W of ein R such that (i) to each ze W, there corresponds a unique element 
& in the Lie algebra R of R such that exp X =g, exptX € W, 0<t<1, and 
(ii) if Ad is unipotent, then Ad X is nilpotent. Put 


Vi = {r: yor (ys) E Wii = 1,2,° + +, a}. 


This is a neighborhood of 1». 

Now let us find another neighborhood of 1. We note that, for ge R, 
Adg.leaves invariant both N and [N,N]. Therefore Adg induces an auto- 
morphism 7*(g) of the linear space N*==N/[N,N]. The kernel of this 
representation has N as its e-component, and hence 7*(R) is abelian. Let ®©, 
be the intersection VM. From (5.2), ®, is a lattice in N. Since N is 
stable under deformation of %o, r(&)—=NNr(®,) are all lattices in N, 
re R,(®,R). By Malcev’s results [9], to each r there exists a unique 
automorphism t, of N such that r(B) =t- (8), B€@. Let t,* denote the 
automorphism of N* induced by #,. The map r— t,* is evidently continuous. 
Since t,,* is the identity, from (8.1a) we can find a neighborhood VU, of ro 
in #&1(®o,#) such that if rE V: and if ¢,*y* (yı)str* t commutes with n* (yi). 
(t= 1,2,--+-,a), then tr*n*(yi)s = 7* (ys) str* where 7*(ys),. denotes the 
semi-simple part of që (yı). 

Now let us show that the neighborhood V, N V- has the required property. 
Suppose r€ Vı N V: and 9: N— N* to be the projection. For B€ @, we 
have 

EN) =r (vs) (B)r (7) =r (y) t (B)r (yi)? 


whence 


try (14) 8(B) = 98 ER). 


The image 6(@,) is a lattice in N*, and therefore t,*y* (yi) = n* (r (y4) )tr*. 
It follows that 


ee 
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where the lower index s denotes the semi-simple part. Since „*(R) is abelian, 
n*(y), commutes with y*(r(y:))s From our choice of Ua, we have then 
t-*n* (vi)e = 0" (74) str* Whence q" (y1)a = 7* (r(y:))e By (8.1b), the product 


q? (ya) 29" (r (y) ) =n" (yr (4) ) 


is unipotent. (2.2) then implies that Ad(yr'r(y,)) is unipotent on the 
Lie algebra N of N. Let X be the element in the Lie algebra of R with 
exp X = yr (yı) as given in the definition of Y,. . Then ad X is nilpotent 
on Ñ and hence XEN. It follows that r(y) € yN and q (yi) =ar (ys). Since 
Yu’ “*, Ya generates bo, r(y) =t(y) for all yin &. (8.2) is thus proved. 


(8.3) Suppose that G, S, R, N, To, m,‘ : > have the same meaning as 
in Section 7. Then (y) =rr(y), yETo rE Ri (Lo, G). , 


Proof. The quotient R/N, being connected, simply-connected and abelian, 
has an intrinsic real linear structure. Let us take R/N to be a real vector 
space. By (5.2), #(ToNR) is a lattice in R/N. We can find y1,y2,° © °, Ym 
in MN R such that r(y:),°°-*,7(ym) form a base of R/N. From (8.2), 
ar(y;) =r (yi), +—=1,2,- ‚m. Let Q be the totality of linear combinations 
of x(y:),°° *,7(ym) with rational coefficients. Since r(y) € xr (To). and 
r(T,) is discrete, we have rr(T)) C Q. Now fix an element y€ ro. The set 
{ar(y):7r€ &1(To, G)} is connected; but Q is totally disconnected: There- 
fore ar (y) =x (y) for all r€ R,(T,@). (8.8) is thus proved. 


9. The projection %:G—S. From (5.2), the image A(T,) under the 
projection A: GS (—=G/G,R) is a lattice in 8. Moreover, G,R is stable 
under deformation of T,, and so each rE R(T, G) induces a deformation 
of A(I)) in 8. In this section, we shall show that these induced deformations 
of A(T.) can all be obtained by inner Rome of 8. 

Let us recall the representation 7* which we have used in Section 5. 
Since both N and [N,N] are normal subgroups of G, each g€ @ induces an 
automorphism y*(g) of the quotient N*=-N/[N,N] defined by z[N,N] 
> grg [N,N], cE N. N* is a vector space and so 7* is a linear represen- 
tation. The kernel of n* contains G,X N as its e-component. Therefore 
S—7*(S8) is a covering map. 

Let =I NN and reR,(T,@). From (5.2) and (7.3), r(®,) 
belongs to N and is a lattice in N. We know then from Malcev’s results [9] 
that there exists a unique automorphism t, of N such that ¢,(8) =r (8), BE ©. 
It follows then 


tr(yBy*) =r (yBy*) =r (y)t(8)r (y) yETo, BE ®. 
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Let 1,* be the automorphism of N* induced by tm, and 0: N— N* the pro- 
jection. Then 


t,*9* (y)8(B) —= 0 (r (y) te(B)r(y)*) = 0 (r (y) ) tr*8(8). 


This means that the two automorphisms ¢,*y*(y) and y*(r(y))é* of N* are 
identical on #(®,). But 6(@o) is a lattice in N*, and so they must be 
identical on the entire N®, i.e., 


(9.4) at (ry) ) = tën (y) te. 
From (5.2), the intersection Y, =T; N GSN is a lattice in GSN, and from 
(8.3), r(%o) C GSN, re R,ı(T,,@). Bearing these in mind and applying 
(6.1) with GSN, Yo, 7* taking the places of G, T, p, we obtain 
17 BE Cr (me) A (ty (Yo) t) 
= Q (q* (r(Yo))) C A(n* (GSN) ) = A (4° (8)). 


Since § is semi-simple, 7*(S) is the e-component of Q(n*(8)). Hence 
(SS) 


and therefore t,* induces an automorphism o,” of n*(8). The map r—o,* 
is continuous. It follows then from the connectedness of #1(To, G) that o,* 
is an inner automorphism of 7*(S). 

We know that 9 is semi-simple, and the map 7* |s: S->n*(S) is a local 
isomorphism. There exists then a natural one-to-one correspondence between 
inner automorphisms of § and those of „* (8). Denote by o, the automorphism 
of 8 corresponding to o,*.. Then y*or(s) = o,*n*(s) for all se S, and then 


(9.2) rar = or nr. 
Moreover, we can easily see that 
(9.3) n* (g) =7*A(9); g E GSN. 


Now take an arbitrary but fixed element £ in the intersection Yo = T, N G.SN. 
Since G,8N is stable under deformation of Ty, r(8) € GSN, re R(T, @). 
From (9.1), (9.2), (9.8) and the definition of o,*, we have 


rl) = AR) = 7*orA(B). 


Let Z* be the kernel of the local isomorphism 7* |s: S>7*(8). Then the 
above equality tells us that Ar(8) and o,A(f) can only differ by an element 
z(r) in Z*. In other words, í 
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oA (B) —=A(r(B))a(r), 2(r) €2*. 


As r runs through #@1(To, G), 2(1) describes a connected set. But Z* is 
discrete, and so z(r)=2(r,)=e. Hence 


(9. 4) ok (8) =ìÀr (£), rE R (To G), BE Yo. 


Now let us show that formula (9.4) holds not only for 8 in Y, but also 
for any element in Ty. Suppose y to be arbitrary but fixed element in To. 
Put sı == o,À (y), 82==Ar(B), 3—=S2's;. Since Y, is a normal subgroup of 
To, ypy E W for all BE Yo. From (9.4), we have then 


sa (àr (B) )sa™ = Ar (yBy*) = ord (yBy*) = Silo (PB) Js = si (àr (£) a, 


or what is the same, 
(9. 5) 83(Ar(B) J8 = Àr (8), BE Wo, re #Ri(Ts, @). 


On account of (5.3) and (8.3), r(%,) is a lattice in G,SN, and so Ar(W,) is 
a lattice in §. Now S is a semi-simple Lie group without compact factor, 
and s, is an element which centralizes the lattice Ar(Wo) in S. It follows 
then that s, belongs to the center of $. Since s depends continuously on r. 
8, describes a connected set when r runs through (To, Œ). Therefore 8; == e, 
whence 

ord (y) = 8, = s = àr (y), YE To rE Ri(Vo, G). 


Summarizing the above results, we have 


(9.6) To each r€ R,(To, G), there corresponds an inner automorphism 
or of 8 such that o,A(y) =Ar(y), for all yE To. Moreover, the map T> cor 
18 continuous. 


10. A subspace of R(X., G). The main purpose of this paper is to 
give a description of deformations or T, in G. In this section, we shall show 
that our problem can be reduced to the description of a subspace of R (ro @)- 
Let us first state the following rather evident proposition. 


(10.1) Let M be a subgroup of a direct product L= L, X L,, and 
p: L— L, the projection. If (M) and MN Le are lattices in L, and L, 
respectively, then M is a lattice in L. 


Now we assume that G, Œ, Ga 8, R, N,1,- + + have the same meaning . 
as before and’ that the semi-simple part of G has no compact factor. Put 


R o =m {re R (To, G) : yır(y) € Ga yE To}, 
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and D =m (To). From (5.3), we know that TY is a lattice in G., and 
hence &,(T,’,G,) has a meaning. Suppose that ge 8, (TY,G) and uE Ra. 
Let us consider the map r: Tp > G defined by 


(10. 2) r(y) = (qm: (y), rete (y) ), y € To- 


By using (10.1) and the definition of R., we can easily verify that +(T)) is 
a lattice in G. To see that re Rı(Do G), let us take an are q; (0 StS 1) 
in R(T, @) with q.==q and qo being the identical map T,’—>G,. Define 
Vi: To G by 

Vily) = (qm: (y) mu (y)) OSS 


Then F; (OSt<1) is an arc in R (To G) with F=f, Vomu where 
R (To, @) denotes the space of all isomorphisms w: To— G such that œ(T%) 
is a lattice in G. Since u is an element of Rı(To, Œ) so must ber. Hence 
to each element q of R(T, G,) and each element u of Ra, there corresponds 
an element r of R,(T,@) as given by (10.2). Let us denote this corres- 
pondence by h: R, (1Y, Gi) X R> Ri(To, G). 


(10.3) The map h is a homeomorphism of R(T, G) X Re onto 
RH (To G). 


Proof. The continuity of A is obvious. To prove (10.3), it suffices to 
construct a map which is inverse to h. Suppose rE R,(T,@). From (5.3) 
and (7.3), we know that mır(T,) is a lattice in G, and that the kernel of 
mr(To) is ToN Ge Therefore mır gives an isomorphism p: Tı’— Gh, and 
moreover p(T’) = mır (To) is a lattice in G,. The map r—p is continuous. 
Now we define u: T)—>G@ by uly) = (ily), mr(y)), yETo. It can be 
verified easily that u is an isomorphism and u(T,) is a lattice in G with 
yilu(y) € Gz, y€T>. This u depends continuously on r, and so u describes 
a connected set as r runs through R, (To, G). Hence u€ R,(T,@) and then 
u€ Ra We have thus a continuous map 5: RT, G) > R: (T7, Gs) K Re 
given by r— (p,u). It is a trivial matter to see that both Aj and jh are 
identity maps. (10.3) is thus proved. 

Since G, is semi-simple and has no compact factor, the space R(T, @) 
is known [15]. Therefore the study of R,(T., @) is reduced to the study of 
Re For this purpose, let R*— {re R,(T,@): y*r(y) € N,y € Po}, and let 
Ade & denote the group of inner automorphisms of G induced by elements of 8. 
This group Ads S is locally isomorphic with S and has a finite center. 

Suppose (r,r*)E Adag X R*. We define r: T,—>G by putting r(y) 
=r(r*(y)), y€ To. This r is evidently an element of R,(T,G@). Let us 
see that r belongs to R.. Taking account of the fact that 


206 HSIEN-CHUNG WANG. 


m(g) =m(7(9)), gE G, 
we have 
mi(ytr(y)) =a (yt? (y)) =m (vy) mi (r*(y)) 

=m (y*r*(y)) E m (N) =e. 


This tells us that y*r(y) € G2, yE€To, or what is the same, re Ra Thus 
we get a map k: Ada S X R*— R. defined by (7, r*) or. 


(10.4) The map k: Ada 8 X R*—>R, is a surjective local homeo- 
morphism. 


Proof. The continuity of k is obvious. To see that it is surjective, 
let r be an arbitrary element of R.. From (9.6), there exists an element s 
of § such that 


(10. 5) Ar(y) =s (y), YET. 


Define g*: Tp Q by q*(y) =s7r(y)s, yE To. By (10.3) R, is connected 
whence we see immediately that g*€ R,(T.G). Moreover, from (8.3), 
(10.5), and the definition of R., we have 


a(y*q*(y)) =e, A(y tg? (y)) =A(y*)a(s*r(y)s) =e, 
N) =m (yer (y) 8) =m (yt) m1 (yr (y) )m (8) =e. 


These three equalities tell us that y+q*(y) € N, or what is the same, g*€ R*. 
Let o be the inner automorphism of G induced by s. It is evident that 
k(o,q*) =r, and hence k is surjective. 

Now let us show that % is locally one-to-one. Suppose that two elements 
(0,1*), (n,9*) of AdgS X R* have the same image under k. Then 
o(7*(y))=r(q*(y)), or what is the same, rto(r*(y)) =q* (y), y€To 
Since both y*r*(y) and y*g*(y) belong to N, we have Ar*(y) =A(y), 
AQ" (y) =A(y). It follows then trto(A(y)) =A(y), yETo. But A(T>) ig a 
lattice in 3, and so the automorphism +"!o must be the identity on 8. There- 
fore r!a belongs to the center of Ade S. From the semi-simplicity of Ade 8, 
we know then that % is locally one-to-one. 

It remains for us to show that & is an open map. For this purpose, we 
fix a point (7.,7,*) in Ade S X R*, and let k(7,71*) =f. Choose a neigh- 
borhood U of 7, in AdgS such that, restricted to U, the covering map 
f: Ada8 > Ad 8 is a homeomorphism. From (9.6), there exists a continuous 
map b: &1(T%,@)—> AdS with the property that 


Ar(y) =b (r) (A(y)),y€ Tore R1 (To, G). 
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Since f(n)=b(r,), we can find a neighborhood W of r, in Ra such that 
b(W) Cf(U). For each re W, put r= (f |u) ln), Hy) rt), 
y€T,. Then r*€ R*, and the map r— (r,r*) is a well-defined map of W 
into AdgS X #&*. This map is a local inverse of k, and hence k is a local 
homeomorphism. This completes the proof. 

‘From the above proof of (10.4), we know that if two elements (o,r*), 
(7, q*) of Ada S X R * have the same image under k, then ro is an element, 
say w, of the center F of. Ade S. It follows then that g*(y) =u(r*(y)), 
yET,. This suggests to us that k should be a regular covering map with F 
as the covering group. Now let us verify this in detail. Since Ad¢S is 
semi-simple and has a faithful linear representation, F is a finite group. 
To each w€ F, we define a transformation T(w) of ade S X R* by putting 
T (w) (0,r*) = (cw, w0r*) where wor* denotes the iteration of the two maps 
1#; Ty G, o: G->G. It can be easily seen that 


worte R*, T (ww) = T (w) T (w2), kT (w) =K, w, w, we € F 


and thus T (F) forms a finite transformation group of Ada S X R*. If o is 
not the identity, then T (w) has no fixed point. Moreover, from the remarks 
at the beginning of this paragraph, two elements in Ade S X R* have the 
same image under k if and only if they belong to the same orbit under T(F). 
Therefore 


(10.5) The map k: Ada 8 X R*—> R. is a regular covering map with 
T (F) as the covering group. 


Let Ro” be the connected component of #* containing the identity map 
fo and F, the subgroup of F consisting of all the elements w such that 
T(w) (Ada S X Ro) = Ade SX Ro”. Since @* is a closed subset of 
& (To, G) defined by real analytic equations, R* is locally connected. From 
the connectedness of R .*, it follows then that the covering map k must carry 
Adc IX ®,* onto the entire Re. We have therefore 


(10.6) Adeg X Ro* is a regular covering space of Ra with k as the 
projection and the finite abelian group T(F,) as the covering group. 


11. Main results. From (10.3) and (10.6), the problem of deforma- 
tions of T, in G is reduced to the study of the subspace Ro? of (To, G). To 
describe #,*, let us consider the group rN. On account of (5.3), ToN is 
closed in. G and hence it is a Lie group (in general, not connected) with N 
as its identity component. Let A be the group of all automorphisms of TW 
leaving invariant each connected component of T,N. With respect to the 
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compact-open topology, A forms a topological group. This group is closely 
related with the space Q, with the compact-open topology, of all isomorphisms 
r: T'o—> G such that r(T,) are lattices in G and y!r(yJEN for all ye Ty. 
We note that R* == Q N R,(T,@), and that #,* is the connected component 
of Q which contains the identity map ro: yp > G. 

Let ac A. Then a(T,) is obviously a lattice in G. Denoting, by j(a), 
the restriction of a on To, we have therefore a map 7: A> Q. 


(11.1) The map j is a homeomorphism of A onto Q. 


Proof. To see that j is one-to-one, let a,a’€ A and j(a) =j (a). Then 
a(y) a’(y), y€ To. Since T, is a lattice in G, ToN N is a lattice in N. 
Now the two automorphisms a, a’ being identical on the lattices Tp N in N, 
they must be identical on the entire N. It follows that a == a’, and hence j 
is one-to-one. 

To see that 7 is surjective, let us take r€ Q. Since y7r(y) EN, ye Ts, . 
we know that r(Tfo NN) =r(1,) NN. The two lattices Py NN, r(To) NN 
in N are therefore isomorphic. It follows then from Malcev’s results [9] that 
there exists an automorphism o of N such that 


(11.2) r(B)—=o(8), BETAN. 
Hence 
o(yBy*) =r (yy) =r (y)r(8)r (y) = =r (yo (8) ry) 
BEDNN, yE. 


This means that the two automorphisms Adyr(y)°o and o:Adyy of N 
coincide on the lattice ro N N in N, and so they must coincide on the entire 
N. In other words, 


(11.3) o(ynyt) =r (y)o(n)r(y) =, yE ro nEN. 


Now let us extend o to an automorphism of T,N. Each element x of T,N 
takes the form t= yn, yET, nEN. On account of (11.2), if yin == yore 
with y,y2 € To m,n2€ N, then r(y:)o(m) =r (y:)o(n:). Hence the map 
a: ToN TN defined by a(x) =r(y)o(n) is a well-defined continuous map. 
Moreover, we can verify directly by using (11.3) that a is an automorphism 
of ToN. Since y'r(y)EN,yET,, this automorphism a leaves invariant every 
connected component of ToN, and therefore a€ A. It is evident that j (a) =r. 
We have thus proved that 7 is surjective. 

Now let us show that j is a homeomorphism. Suppose that {a,} be a 
sequence in A. We note that the convergence of {aj} in A is the uniform 
convergence on compact subsets of T,N whereas the convergence of {j(a,)} 


DEFORMATIONS OF LATTICE. 209 - 


is the uniform convergence on compact subsets of T. Therefore j is con- 
tinuous. To see that j is open, let us assume that limj(a,) = j (a), where a 
is an element of A. Since N is a connected and simply-connected nilpotent 
Lie group, we can identify it with its Lie algebra N by means of the exponential 
map, and thus N has the structure of a real linear space. Each automorphism 
of N is then a linear transformation. According to Malcev [9], there exist 
elements £1,82,' © `, Bm Of the lattice ro N N in N such that they form a base 
of the linear space N. “Hach automorphism of T,N induces an automorphism 
of N, and therefore corresponds to a matrix with respect to the base 
Bo Ba," * ‘> Bm of N. Let M be the matrix corresponding to a, and M; corres- 
ponding to a (t<—1,2,---). Since limj(a) =j(a), we have lim M, == M. 
This implies that, restricted to any compact subset of N, the sequence {a} 
is uniformly convergent. Now let K be a compact subset of T,N. There exist 
elements yı, ya,‘ ` `, ys of T, and compact subset K’ of N such that 


K Cc yıK U yok’ U ee a Uyk”. 


Since {a} is uniformly convergent on K’ and also on the finite subset 
{Yu Yo" © sYa} Of To, it follows that {a} is uniformly convergent on K. 
In other words, lim a==a. Therefore j is a homeomorphism and (11.1) 
is proved. 

Let A, be the e-component of the group of all automorphisms of T,N. 
Since N is the e-component of T,N, A, belongs to A and hence is the e-com- 
ponent of A. From (11.1), it follows directly , 


(11.4) The map j carries A, homeomorphically onto R o*. 
Combining (10.3), (10.6) and (11.4), we have the following 


Main THEORRM. Suppose that G, To, Gi, Ge, 8, N, m, me have the 
same meaning as before. Let A, denote the e-component of the group 
of automorphisms of ITN with the compact-open topology. For any 
r1€ Rlm (Io), G&G), o€ AdgS and a€ Ao, the map r:T—>G@ defined by 
t(y) —= (rum (y), moa(y)), yET> ts an element of Rı(To G). The corres- 
pondence (1,,0,a4) >r so obtained is a regular covering map of the product 
R (m (To), G1) X Ade S X A, onto Rı(Tao G) where the covering group is 
isomorphic with a subgroup of the center of Ade 8. . 


This theorem reduces the problem of deformations of T, in @ to the 
problem of deformations of lattices in G, which has been completely solved 
by A. Weil [15]. As an immediate consequence, we have 


5 
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COROLLARY. Under the same assumptions as above, the space (To, G) 
is a manifold. 


Appendix. 


Now we give a complete proof of the somewhat generalized version of 
the results of Auslander [2] and Zassenhaus [16] mentioned in Section 3. 
Since we do not assume the subgroup L to be discrete, the statement in 
Theorems A and B is more general, and hence some refinement of the proofs 
of these authors is required. 

Let Af be a subset of a topological group G. We shall use ¥,(M) to 
denote the totality of commutatosr 


[gilgel: -e igea gdt JI], weMU 
of length s. By im£,(M) =e, we shall mean that given any neighborhood 
ara 
U of e, there exists an integer n such that £,(M) C U for all s&n. 


Lemma 1. Let V be anormal subgroup of a connected Lie group G, and 
m: G—> G/V the projection. If V ts isomorphic with a real vector space, then 
there exists a neighborhood W of e in G/V such that, for any compact 
subset K of G with x(K) C W, lim &,(K) =e. 
8 > oo 


This has been proved by L. Auslander in [1] and is also a direct conse- 
quence of formula (18) in [16] together with the Ado Theorem which asserts 
the existence of a local isomorphism p of G into GL(R,n) such that p(V) 
contains only unipotent matrices. 


Lemma 2. Suppose that Q, V, m, W have the same meaning as in 
Lemma 1. Let L bea closed subgroup of G with its e-component L, solvable. 
Then LO w*(W) generates a solvable group. 


Proof. Let K,K,,' - - be an increasing sequence of compact sets in G 
such that U Kı =r (W). Put Q—K,L, and denote by P; the subgroup 
generated by Qu From our choice of W, lim £,(Q,) =e and hence there 

8-3 o 


exists n such that £,(Q;) CL. Let $: L>L/L, be the projection. Then 


Ln($(Vi)) = pEr (Qi) =e 


and then #(Q;) generates a nilpotent group [16, p. 291]. Since L, is solvable 
and ¢ (P1) is generated by ¢(Q,), P; must be solvable. We have therefore an 
increasing sequence P, C P, C P C+- + of solvable subgroups of @. Their 
union P==U P, is solvable [16] (Zassenhaus proved this when P4 are sub- 
groups of GL(R,m). But this can be trivially extended to the case that P; 
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are subgroups of a connected Lie group by using the adjoint representation.) 
From the fact that U K;—21(W), we see immediately that P is generated 
by 77(W) OL. The lemma is thus proved. 


THEOREM A (Zassenhaus, Auslander). Let G be a connected Ine group 
with tts radical R simply-connected, m: G—>G/R the projection, and L a 
closed subgroup of G. If the e-component L, of L ts solvable, then the e-com- 
ponent of the closure of m(L) is solvable. 


Proof. Let q be the length of the derived series of R. First we assume 
q=1. By Lemma 2, there exists a neighborhood W of e in G/F such that 
m+(W) N L generates a solvable group. Therefore the group H generated by 
WM-a(L) is solvable. Since W is open, 7(L) N W is dense in x(L) N W, 
and hence (lL) NW C Ë. But the e-component (x(L)), of (L) is 
generated by any neighborhood of e in (L). Therefore (r(L)), is con- 
tained in H and is solvable. Theorem A is thus proved for g—1. 

Now assume Theorem A to be valid when the length of the derived series 
of R is less than q. Let G*—G/[R,R] and q: G> G*, E: G*— G*/n(R) 
(= G/R) be the projections. By induction hypothesis, L* 7(L) is a closed 
subgroup of G* with its e-component Lo” solvable. Since 7(#) is isomorphic 
with a vector space, we know from the preceding paragraph that $(L*) has 
a solvable e-component. Since (L) =£(L*), it follows that (x(L))o is 
solvable. This completes the induction and proves our theorem. 


TuHeorem B (L. Auslander). Let G be a connected and simply-con- 
nected Ine group, R its radical, C the maximal connected normal compact 
subgroup of a semi-simple part of G, and 6: G—G/CR the projection. 
Suppose that L is a closed subgroup of G with tts e-component solvable. If 
6(L) has the property (S) in G/OR, then 6(L) is discrete. 


Proof. Let 7: G>@/R, p: G/R>G/OR be the natural projections. 
From Theorem A, the e-component (a(Z)), of (L) is solvable. The pro- 
jection œ has a compact kernel, and so ¢ must be a closed map. Hence 
¢(x(L)) is closed and has &((r(L)).) as its e-component. Since 9 = dr, 
we can see easily that #((#(L)),) is invariant under Ad (L). But G/CR 
is semi-simple and has ano compact factor, and 9(L) has the property (8) 
in G/CR. It follows [4] then that #((”(L)).) is a normal subgroup of 
G/CR whence ¢((x(Z'))o) =e. This tells us that 4(x(L)) is discrete. 
The subgroup #(L), being contained in ¢(x(L)), is therefore discrete. 
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PARTITIONS INTO ODD SUMMANDS.* 


By PETER Hacis, JR. 


1. Introduction. 1. In an earlier paper [1] the author has investigated 
the problem of determining the number of partitions of a positive number n 
into summands which are congruent modulo p to elements of a set a or their 
negatives, where p is an odd prime, and a = {a,,d,,' ` `, Qr} with 1 S 4 S p/2. 
A convergent series for this partition function was obtained by using the 
circle dissection method of Rademacher [6]. The necessary transformation 
equations as well as estimates of the magnitude of certain exponential sums 
were obtained by using the procedures of Lehner [5]. Asymptotic formulas 
were also derived. In the present paper we wish to extend our study so as 
to include the remaining prime, p==2. That is, we wish to find a convergent 
series and asymptotic formulas for g(n), the number of partitions of n into 
positive odd summands (or equivalently, into distinct positive summands). 
The methods employed are essentially the same as in- [1] and free use will 
be made of the results obtained in the earlier paper whenever they. sie 
‘applicable. 
‚> The study of q(n) is, of course, nae new. In 1940, "Bua el, ee 
heavily on results from the theory of modular functions, was the first to 
represent g(m) as a convergent infinite series. More recently, Iseki [3,4] 
has obtained a convergent series representation, as well as asymptotic formulas, 
for a more general partition function which yields the number of partitions 
of an integer. n into summands which are. relatively prime to a given integer 
M=2. The case M=? (or M—4) obviously gives q(n). The circle dis- 
section method is used by Iseki, but both his procedure for obtdining--the 
transformation equations and his. technique for reducing the exponential sums 
to Kloosterman sums differ from those of Lehner. Indeed, Iseki remarks 
that Lehner’s-methdd:doés not seem" to work if (M, 6) > 1. For p—3 it is 
shown in [1] that Lehner’s procedure can be applicd. In the present paper 
it is shown that Lehner’s method, with es a slight modification, can be 
applied to. the case p= 2. 
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2. The transformation equations. 2. The generating function of q(n) 
is given by 


F(z) S ma — mel) wn | + a(n) 


which is convergent in the interior of the unit circle. Since it is necessary 
to determine the behavior of F(z) in the neighborhood of rational points on 
a circle concentric to the unit circle and of radius less than one, we take 
T == Oxp{Rath/k —21z/k} where #R(z) >0, (hk) =1, OSA<E. 

With r==1, a= {1}, we have from Section II in [1] 


wo x we kel 
Gale) — 5 5 nirlpm-i)n + > > notaglpm-Dn 


n=1 m=0 n=l mm 
satisfies the equation 


Ga(x) = Ol) — mit (ds—B/2) /12phi—on(h, k) /2} 
if p | k, and 
Ga (2) = Ja (a) — rif (A2— 1/2) /12pki + log (2 sin za/p) /2ri 


— talh, k) /2} 
if p{k. 


Here, = exp{2ath’/k —2n/kz} and s” = {2xiH’/k—2r/Kz} with W 
defined by hh’ =— 1 (modk), H’ defined by phH’=—1(modk), and 
K == pk. b={b,} where b= + h (mod p) whichever yields 0 < b, S p/2. 
A = p’— 6p + 6, B= p*— 6b,p + 6b,?, and a is defined by ak = 1 (mod p) 
with 0<«< p. Also, 


valh, k) = Z ((u/k)) ( u/k)) wm 1, p +1, ,k—p+1,p—1, 
ep—1,:--,k—1; 


ta(h,k) = X ((u/K)) ((ha/k)),u—1,p-+1,- i ,&—p-+1p—1, 
22—1'',K—1; 
with (@))=e— [z] —4+ le). 
Finally, 
Ja(z) = >. min |- È migram where 


p = exp (2ria/p), p= exp (— enta/p). 


The proof of this result given in [1] for p= 3 also holds for p—2, in 
which case we have b= {1} =a, A=B=—2, amm 1. With p=3 
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log F(a) =4}($ Ywraem S Sinig) 
n=l m=0 n=l m=i 
= $Ga(z). 
By exponentiation we obtain 
THEOREM 1. F (x) satisfies the transformation equation 


F (oxp{2rih/k — 2rz/k}) = o (h, k)exp {r (z— 1/2) /12k} 
` F (exp {2rih’ /k — m /kz}) 
if 2 | k, and 
F (exp{2rih/k —2nz/k}) — 7x (h, ke) exp{m (1/2 + 22) /24k) 
- H (exp{2aiH’/k —r/kz}) 
if 2T k. 
Here, 2hH’==—1 (mod k) ; 
(2.1) w (h, k) = exp {rto (h, k) }, 
o(h,k) = ((u/k)) ((he/k)) p= 1,8,  ,k—1; 
x(h, k) = exp{xtt (h, k) } 
t(h, k) = Il (u/2k) ) ( (hu/k)) w= 1,8," + +, 2k—1; ; 
H (2) “HG +2) ae F (g). l 
This result is in agreement with Theorem 1 in [4] if we take M = 2 in 
the latter. 


(2.2) 


3. Estimates of certain exponential sums. 3. In the sequel it will be 
necessary to have some information concerning the magnitude of certain 
exponential sums involving o(h,k) and x(h,k). The trivial estimate 0(k) 
will not suffice so we must now undertake a study of these sums. Our procedure- 
will be to reduce them to Kloosterman sums. The method used is essentially’ 
Lehner’s. Many of the details will be omitted and the interested reader is- 
referred to [1] and [5]. 

We must discuss three cases, k==0(mod4), k==2(mod4), and’ 
k=-+1(mod4). Considering first the case 4 | k we find (see (5.1) in [1], 
with p == 4, r==1) that 


24ko (h, k) = 2h (2k? — 6k —2) —3k(k —6 + 2c) —48 u[hu/k] 
M 
where M == {pn |a=1,5,: © -,k—3} and 


{1 if hesi (mod4) 


e= 13 if h=3 (mod 4). 
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Thus, 24ko(h,k) is always an integer. Furthermore, 

(3.1) 24ko(h,k) = 0 (mod3) if 37h. 

We also have (see (5.5) in [1]) 

(3.2) 24hko(h, k) = h®(2h® — bk — 2) — (2 + k?) — bhk (c — 2) — 48k8 
where S = 32 [hp/k]([hu/k] +1) ie an integer. 


Now let fG —48 where f is the greatest divisor of 48 prime to k. If 
3 | k then f—=1, G= 48, while if 37% then f =3, @-—16. If we now take 
h’ so that Ah’ =— 1 (mod Gk) and multiply (3.2) by A’ we obtain 


(3.3) 24ko (h, k) = hu + h'o — 6k(c— 2) (mod Gk) 
where u = 2k? — bk —2, v= 2-+4 KR. 
Using (3.1) we see that 
(8.4) 24ko(h,k)=0 (mod f). 
If we define the integer ¢ by the congruence f#==1 (mod Gk) we have 
by (3.3) and (3. 4) 


"dhe (h, k) =f (uh + vk’ —6k(c—2)) (mod Gkf). 
Therefore, Ze 


o (h, k) — exp{2ri (24ko (h, k)) /48k} 
== exp{ ri (p (uh + vh’) /Gk — 6¢(c¢—2)/G@)}. 


4. We turn now to the case k==2 (mod 4). Since Lehner’s method 
must be modified slightly we shall be more explicit in our presentation here. 
We note first that from (2.1) and the properties of ((z)) it is easily estab- 
lished that 


(3.5) 


a (h, k) =Z ((w/E)) ((hu/k)) 
where K —2k and P= {a| a=1,3, ° -,K—1}. Thus, 
(41) (h,k) =J (P/E —1/2) ((ha/k)) =Z aE ( (hu/k)) 
since D ((ħu/k)) =0. Writing M= {u |a—1, 5,- :,K—8} we have 
o (h, k) w= E K ( (huk) ) + (K—p) K>( (h(E —n)/#)) 


M 


2S uK ((hu/k)) 
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— Z pkh (hu/k — [hn] 1/2) 

where we have used the fact that D ((hu/k)) =} X (hayt) =. An 
easy aiaiai gives hka S pè = h (4k? — Gk — 1) /6k and —4k“ Ir 
== — (k—1)/4. Therefore, 
(4.2) 12ko (h, k) = 2h (4k? —6k—1) _—3k(k—1) —12 Sal hn/k]. 
We conclude that 12ko(h,k) is always an integer and that 
(4.3) - 12ko(h,k)=0 (mod 3) if 34%. 


To obtain further information about o(h, k) we calculate 5 ((hu/k))* 
P 
in two ways. In the first place 


& ((Au/k) Yo D (hufb— [hp/k] —1/2)* 
— Bh Zu (hu/le— [/] — 1/2) — Me Ze 
+2 [hn/k] ([ha/k] +1) + 21/4 
L the(h, k) ee 1) 9K + BSP 
‚where we have used (4. 1) and S == 32 Layk (Ihn/#] +1) ig an lese. 


(4.4) 


Also, since (h,k) = it follows that 
z ( Chy/k) )? == 2 ((H/l) P= 2 2 ((n/k))? 
where Q = {p | p= 1,3, ,k—1}. 
Therefore, 
È CATE) Ee X (u/le—1/2)?* 
(4.5). ZRH A 
— (k —1)/3k—k/2 + k/4. 

Equating (4.4) and (4.5) we find that 

(4.6) 48hko (h, k) — 4h? (K? —1) — (4 -+ 2%) — 2468 


Writing k ==2k* we now let fG == 48 where f is the greatest divisor of 
48 prime to k*. If 3|% then f—=16 and G=3, while if 3f k then f= 48 
and G—1. If we now define H* by the congruence 4hH*==— 1 (mod Gk*), 
which is possible since (4h, @k*) =1, and multiply (4.6) by H* we have 
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(4.7) 12%ko(h,k) =— h +4H* (mod Gk*). 
Taking h’ so that hki’ ==— 1 (mod Gk) from which it follows that 
hh’ =— 1 (mod Gk*) we have 4hh’==— 4 (mod Gk*). Multiplying by H* 
yields h’==4H* (mod @k*). Since 27 Gk* there is an integer r such that 
4r=1 (mod Gk*). Therefore, H*==rh’ (mod Gk*). From these remarks 
and (4.7) we have 
(4.8) 12ko (h, k) = hu + h'v (mod Gk*) 
where u == —— 1, v= 4r. 
A discussion of congruence modulo 16 is now necessary. Since „el 
(mod 4) we have 12 X u[hu/k] =12 X [hu/k] (mod16). Now, 
M M 
12 È [hp/k] =—12 3 ((hu/k)) + 12hk Z p —6 D1 
M M MW M 
= h (k — 1) — 8k 
== 12hk* — 6h — 3k. 


Therefore, from (4.2) it follows that 

12ko (h, k) =— 12h (k + k*) + 4h + 3(2k— kt) (mod 16). 
Since h = 4n + d where d = — 3 if h= 1 (mod 4) and d= 3 if h= 3 (mod 4) 
we have finally 


(4.9) 12k0(h, k) =— 12d (k + k*) + 4d +3 (2k —k?) (mod 16). 

From (4.3) and (4.9) it follows that 

(4.10)  12ko(h, k) =—12d(k + k*) + 4d +3(2k—k’) (modf). 
Defining ¢ and T by the congruences fọ == 1 (mod Gk*), Gk*r = 1 (mod f} 

we have by (4.8) and (4.10), 


12ko (h, k) = fe (uh + vh’) + Ok*T(— 12d (k + k*) 4 4d -+ 3(2k—k?)) 
. (mod fGk*). 
Therefore, 
a(h, k) = exp{2mi (12ko (h, k) )/24k} 
(4.11) = exp{?Ari(p(ul + vh’)/Gk* 
+T(—12d(k + k*) -+ 4d +3 (2k—k?))/f)). 
5. We now consider the case 2f k. From (2.2) and the properties of 
((z)) it is easily established that t(h, k) > ((p/K))((hu/k)) where 


K=4k and P= {pu |y=1,3,5,---,K—1}. It then follows (see (6.1) 
in [1] with p=4, r==1) that 
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(5.1) 24ki(h, k) = 2h(2K* — 6K — 2) —3k(K —2—2a) —12 X u[hu/k] 
M 
where M = {p | u=1,5,: --,K—8} and a is defined by ka= 1 (mod4), 
0<a<4. Thus, 24kt(h, k) is always an integer, and 
(5.2) 24kt(h,k)=0 (mod 3) if 8k. 
We also have (see (6.5) in [1]) 
(5.38) 4hkt(h, k) —h?(2K?—6K —2) + (1—k*) + 6hka —12kT 
where T=4 > [hu/k]([hu/k] +1) is an integer. 
M 


Now let Fg==48 where F is the greatest divisor of 48 prime to k. If 
3|% then F—16, g—=3, while if 3fk then F—48, g—1. If we take h’ 
so that A’=— 1 (mod gk) and multiply (5.3) by A’ we obtain 


(5.4) 24kt(h,k)=hu + kv (mod gk) 
where u == —2, ve=—1. 


A discussion of congruence modulo 16 is now necessary. Since „1 
(mod 4) we have 12 X p[hu/k] =12 X [hu/k] (mod16). Also, I ((hu/k)) 
M M M 


= 0 since the u in M constitute a complete residue system modulo k. There- 
fore, 


12 È [ha/k] —— 12 X ((hu/k)) + 12hk* Z u — 6 3146 D8 (hy/k) 
M M M M M 
= 24hk — 12h — 6k + 6. 
From (5.1) it follows that 


(5.5) 24kt(h,k) == 12k(1—k) + 6(ka—1) (mod 16). 
From (5.2) and (5.5) it follows that 
(5. 6) 24kt (h, k) =12k(1—k) + 6(ka—1) (mod F). 


Defining ® and y by the congruences F#=1 (mod gk), gky=1 (mod F) 
we have, by (5.4) and (5.6), 


24kt(h, k) =F (uh + vk’) + gky(12k(1—k) + 6(ka—1)) (mod Fgk). 
Therefore, 
x(h,k) — exp {2at (24kt (h, k) )/48k} 
(5.7) = exp{2xt( (uh + vh’) /gk 
~+-y (12k (1—k) + 6 (ka —1))/f)}. 
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6. THEOREM 2. The sum 
 Alnv;k;d;o,o)—= 3S! w(h, k)exp{—2ai(hn—h’v) /k} - - 
kmodk : f 


where h=d (mod), 2f d; 1 SW<o, (mod k), 0S0, <o Sk, 2 |k, is 
subject to the estimate 0(n1/8k?/*+) uniformly in v, d, 01, 0z. 


THEOREM 3. The sum - 
B(n,v3k301,02) = X x(h, b)exp{— 2m (hn — Hv) /k} 
-. Amodk 


where o, Sh’ < o (mod k), 0S o, <0: Sk, 2k is subject to the estimate 
0 (naisele) uniformly in v, 01, 02. 

Here o,, o, are integers, Ah’==—1(modk), 2hH’=—1 (mod k) and 
SY indicates that h runs over integers prime to the modulus of the sum. 
Using (3.5), (4.11) and (5.7) the proofs of these theorems are identical 
with those of Theorems 2 and 3 in [1] and are therefore omitted. 


. 4 A convergent series and asymptotic formulas for q(n). 7. By 
Cauchy’s integral formula we have . 


2m 


= AS, TP (2) de — 3 9, Sr 2) de 


where '0 Sh <b SN and &, are the Farey arcs of order N of C, the circle 
| z | = exp{— 2N}. If on the are & we introduce the variable œ by 
the equation s= exp{— rN + 2rth/k-+ rtp} and write w—N-? RN 
z == wk we obtain s rý aad 


a(n) = N exp(— Brink /k} S Fie E E E E TA 


Here # == 1/k(k + k) and 0’ = 1/k(k + ke) where hı/kı < h/k < halts are 
consecutive terms in the Farey series of order N. 

Splitting the sum over k into 2 parts q(n,0) and q(n,1) according to 
whether 2.| k or 27% respectively we have g(n)—g(n,0)-+q(n,1). B 
Theorem 1, 

1(n, 0) = 3’ o (h, k)exp(—Brinh/k} S. SO EN 


-exp{ — (m/Rw) (2r-+ 1/12) + mw (2n + 1/12) }dg 
where 2 | k. 


Tf we: split: q(n,0): into 2 -parts according as h=31 (mod4) or he=3 
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(mod 4) then, since 2v + 1/12 > 0, we have using Rademacher’s argument 
[6] and Theorem 2 
g(n,0) = 0 (nN -13e exp {2anN-*}). 


Turning to g(n,1) we have by Theorem 1 


q(n,1) = 2+? X x (h, k)exp{— 2rinh/t} if 2 ¢(v)exp{2atH’v/k} 
h,k -0’ y=0 
-exp{— (a /2k*w) (2y —1/12) + rw (2n + 1/12) }db 
where atk and where we have written H(z) = > e(v)e”. Splitting the sum 
z = ; 
over v into 2 parts according as y = 0 or v > 0 we have 
q(n, 1) =Q(n) +R(n). 


Since 2v—1/12 > 0 if v>0 we have, again using Rademacher’s technique, 
and employing Theorem 3, 


R(n) = 0 (n8 N-14 3+e p nN 


For Q(n) (see (8.8), (8.9), (8.10) in [1] with p= 4, r= 1) we have 


Qn) ri Beh, n)L(k, Ay + 0 (mtl N-8re exp {2anN-2}) 


where — 

(1%, B(k,n) = 2 x(h,k)exp{— rinh/k}, 

and 

(7.2) L (k,n) =k? (24n +1), ar (48n + 2) 42/128}. 


Here I,(z) is the Bessel function of first order and 2 f k. 
Since q(n) = q(n,0) + Q(n) + R(n) we have, letting N>», 


THEOREM 4. The number of partitions, q(n), of an integer n into 
positive odd summands (or into distinct positive summands) is ore by the 
‘convergent series | 


(7.3) q(n) =r ZB (k,n) L (kn) 


where 2{k and B(k, n), L(k,n) are given by (7.1) and (7.2) respectively. 

This result is easily seen to agree with those of Hua [2] and Iseki [4]. 
Asymptotic formulas for g(n) can be obtained by using the procedures 

detailed in [1]. Indeed, since (7.3) is obtainable formally from (8.11) in 
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[1] by setting r—1, p == 4 in the latter, we have by Corollaries 7.1 and 7.2 
in [1]. 


THEOREM 5. Äsn>o 


q(n) =x (24n +1) VL, {m (48n + 2) 4/2/12} (1 -+ 0 (exp{— en*})) 
where c> 0. 


COROLLARY. As n—-00 


q(m) — 18%/*(24n + 1)-*/* exp{m(48n + 2)42/12} (1+ 0 (73)). 
These results are in agreement with those of Iseki [4]. 
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EXISTENCE OF UNIVERSAL CONNECTIONS IL* 


By M. S. NARASIMHAN and 8. RAMANAN. 


1. Introduction. In an earlier paper [3] we proved the existence of 
universal connections for connections in bundles with a compact Lie group 
as structure group. In this paper we extend this result to the case of an 
arbitrary connected Lie group (Theorem 1). The proof of this theorem does 
not depend on [8]. However, this result does not include Theorem 1 of [8] 
which is more precise in that it asserts that the canonical connections in 
the Stiefel bundles themselves are universal for connections in unitary or 
orthogonal bundles. The latter is useful in some applications. 

Since any two connections on a principal bundle differ by a 1-form of 
the adjoint type, one can reduce the problem of finding a universal connection 
to one of finding a universal 1-form of the adjoint type (§3). Regarding 
the latter problem we prove the following more general result (Theorem 2): 
if p is a finite dimensional representation of’a connected Lie group G and n 
and p are non-negative integers, then there exists a n-universal p-form of 
type p. (For the definition of forms of type p see $2.) This problem is 
essentially one for compact Lie groups (§6) since the structure group of a 
G-bundle P can be reduced to a maximal compact subgroup K of G, and 
forms of type p on P are precisely forms on P obtained by extending forms 
of type p|K (restriction of p to K) on the reduced bundle (§2). It should 
be remarked, however, that the existence of universal connections for a con- 
nected Lie group does not follow immediately from that for compact Lie 
groups, since not every connection on a G-bundle is the extension of a con- 
nection on a reduced K-bundle. (For instance, the holonomy group of a 
connection got by extension will have to be contained in K). In the case 
. of connections, Theorem 2 seems to be necessary for passing from the compact 
to the general case. In our procedure, however, Theorem 2 implies at once 
Theorem 1 without passing through the compact case. 

In the case when G is the orthogonal group O(k) and p is the natural 
representation, an n-universal p-form is constructed explicitly (§4). H G 
is compact we may suppose that p is a representation of @ by orthogonal 
matrices. This enables one to reduce the compact to the orthogonal case (§ 5). 
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For the notions relating to connections in principal bundles we refer 


to [1], [2], [5]. 


2. Preliminaries. In this section, we first fix our notation and termi- . 
nology, and then give a canonical way of extending p-forms of a certain type 
to bundles obtained by extension of structure group. 


By ‘differentiable’ we always mean ‘indefinitely differentiable.’ All 
manifolds, groups, bundles, maps and forms are assumed differentiable. We 
assume all our manifolds are paracompact. By a p-form on a manifold we 
mean a covariant tensor of degree p. If f: M— M is a map and g a p-form 
on M’, f*(«) will denote the inverse image of « by f. 

By a G-bundle we always mean a principal bundle with structure group 
G. If f: H-@ is a homomorphism of groups, P, a H-bundle, and P, a 
G-bundle, a map h: P, —> P, will be called a f-morphism if (és) =h(£)f(s) 
for every é€ P,s€e H. When H = G and f is the identity map, a f-morphism 
will be called a G-morphism. If p is a representation of G in a finite dimen- 
sional vector space V, a p-form on a G-bundle with values in V is said to be 
of type p if i) it is equivariant for the action of G and ii) it annihilates any 
p-tuple of tangent vectors one of which is vertical [2]. If k: P,P, is a 
f-morphism and « a p-form of type p on P,, then h*a is clearly a p-form on 
P, of type (pof). 

Let @,, G, be two Lie groups and f: G,> G a ETE Let T, 
be the functor which associates to every G,-bundle P the @,-bundle T,(P) 
over the same base obtained by extension of the structure group by f. We 
recall that the total space of T,(P) is the orbit space of PX G, under the 
action of G, given by (£, g2)g:— (éga, f (91) *g2) for £E P, se, g2€ Qa. ` 
The action of @ on PX G, defined by (£, ga)ga = (£, gage’) for €€ P, 
Ja, 9X € Ge commutes with the above action of G, and hence G, operates on 
T,(P) and makes of it a G,-bundle. Moreover, if $: P>P’ isa G,-morphism, 
the G.-morphism T,(&): T;(P)—>7;(P’) is induced by the map (, 92) 
— (®(£),92) of P X G; into P’X Ga. 

Let q be the projection P X &,—T,(P) and i the map > q(é,e) of P 
into T,(P). We then have ;(&s) —%(£)f(s), £E P, seh; ie, is a 
f-morphism. 

Let p be a finite dimensional representation of G,. If 8 is a p-form of 
type p on Ty(P), %*8 is a p-form on P of type pof. Conversely, to every 
p-form a on P of type pof we can associate in a natural way a p-form T;(a) 
of type p on T,(P) with %,*7,(a) —a in the following way. It is easy to 
check that the form « on PX G, defined by Kito =p (G2) *(p1*«) eo) 
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(p, being the projection PX @&>P) is invariant under the action of G, 
and annihilates any p-tuple of tangent vectors one of which is vertical. Hence 
there exists a p-form T,(«) of type p on T,(P) such that q*T;(a) =g and 
we have t;*7';(a) =a. Moreover, if 8 is a p-form of type p on T;(P), we 
have T,(t*8) =B. , 

Finally, the correspondence «—>T;(a) is ‘functorial’ in the following 
sense: if ©: P— P’ is a G,-morphism and if a’ is a p-form on P” of type pof, 
then we have 


T,(®*a’) = (T;8)* (Tr). 


3. Statement of the theorems. Proof of Theorem 1. 


THEOREM 1. Let G be a connected Lie group and n a positive integer. 
Then there exist a principal G-bundle B and a connection form yo on B such 
that any connection form on a principal G-bundle P with base of dimension 
Sn ts the inverse image of yo by a G-morphism of P in B. 


We deduce Theorem 1 from the following theorem which seems to be 
of independent interest. 


THEorEmM 2. Let G be a connected Lie group and p a finite dimensional 
representation of G. Let n and p be two non-negative integers. Then there 
exist a principal G-bundle E and a p-form a, of type p on E such that any 
p-form of type p on a principal G-bundle P with base of dimension Sn ts 
the inverse image of a by a G-morphism of P into E. Moreover, the bundle E 
can be chosen to be classifying for dimension Sn. 


` Remarks. 1. A p-form (resp. a connection) which possesses the property 
stated in Theorem 2 (resp. Th. 1) will be called n-universal. 


2. Theorem 2 is also valid with “ p-form” replaced by “ exterior p-form.” 
A universal exterior p-form is obtained by alternating a universal p-form. 


Proof of Theorem 1. We now prove Theorem 1 assuming Theorem 2. 
Let F be a differentiable G-bundle which is n-universal, and y, any connection 
on F. On the other hand, let E be a G-bundle and « a 1-form on E of the 
adjoint type which is n-universal for such forms. Consider the G-bundle 
B = F X E, the action of G on B being given by (f,e)g— (fg,eg), FEF, 
e€ E, g€G. Let 1:B>F, qa: B— E be the canonical projections, which 
are clearly G-morphisms. The differential form Yo = Gi" yi + 92*%, is a con- 
nection form on B since q,*y, is a connection form and g,*a, is a 1-form of 
the adjoint type. We assert that y, is n-universal for connections in G-bundles. 
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In fact let P be any G-bundle with base of dimension = and y any con- 
nection on P. Since F is a n-universal bundle, there exists a G-morphism 
W,: PF. Then y—,*(y,) is a 1-form of the adjoint type since y and 
Y,” (yı) are connection forms on P. Let %: P>E be a G-morphism such 
that Ya* (ao) =y— Y,” (yı). Consider the G-morphism $: P>B defined’ 
by q10 = F; q20 = Y, Then we have 


D* (yo) = D* (qu*yı + 92*%0) 
= (G08) "yı + (g2°®)*a, 
= Wy* (y1) + Wa (a) 
ur) + (y— 9" (y1)) 
=y. 

Remark. In the above construction, it is clear that the bundle B is 
n-classifying if the G-bundles E and F are n-classifying, so that the maps 
induced on the bases by two G-morphisms P—B are homotopic. Thus the 
theorem of A. Weil on connections [1] is an immediate consequence of 
Theorem 1. However, Weil’s theorem can be proved in a simpler way; for, 
all one requires for the proof is that any two given connections yı and y on 
a bundle P can be obtained as the inverse images of the same connection yo 
on a bundle B by morphisms whose projections on the base are homotopic. 
This problem is considerably simpler as can be seen by taking B= P X I and 
(yon = tp* (ya) + (1—t)p*y €€P, teI where p is the projection 
PXI-P (I is the open interval [—2,2]). The inclusions P>PXI 
given by é—> (é,0) and é—> (61) induce yı, y: respectively and their pro- 
jections to the base are clearly homotopic, the homotopy = induced by 
the identity mapping of P X J into itself [3,86]. 


4, The orthogonal case. In this section, we prove Theorem 2 in the 
case where G is the real orthogonal group O(%k) and p is the natural represen- 
tation in R*. We identify O (k) with the group of (k, k) real matrices A such 
that A’A == I, (A’ being the transpose of A) and R* with (k,1) real matrices. 
p then corresponds to left multiplication of (%,1) matrices by (k,k) 
orthogonal matrices. 


_ Let W(N,k), N Zk, be the Stiefel bundle of (N,%)-real matrices A 

such that A’A == I, ([3,82]). O(k) acts on W(N,k) by multiplication on 
A, 

the right. If A€ W(N,k) is of the form | A, | where each A; is a (1, k) 


Ay 
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matrix, the function o; on W(N,%) which assigns to each A the (k,1) matrix 
Ar is of type p. For 

As F 

(As) == oy = (As) =3' Af = sta A) 


for A€ W(N,k), s€ O(k). 


We now construct a n-universal p-form of type p. For the rest of this 
section, N will denote the integer (n+ 1n? -+ (n-k). Let Vae c, Vnan 
be (n+ 1) copies of Rr and V,—=R. Consider the O (k)-bundle 


E=-W(N,k)X VXVıX K Vra 
where the action of O (k) on E is given by 
(w, vop’ + +, Un) g = (09, Y)* * +, Unsa), WE W(N, k), we Va g € O (k). 


Let x (resp. m) denote the projection of E onto W(N,k) (resp. V). Let 
further (a,---,2:*) be the coordinate functions in V, i>0. For each 
multi-index I= (ti, + +,%,°°°,4), 1St-Sn and 1SjSn-+1, we shall 
denote by w/ the p-form 7,*(dzj»®- - -® da?) on E. For convenience of 
notation, let us choose a bijection A of the set of indices (I,5j) with 
I= (i: + i) 1St-Sn and 1SjSn-+1, onto the set of integers 
[1, (n+ 1)n?]. Obviously 77 =ou, Or is a function on E with values in 
(k,1)-matrices of type p. ms being a real-valued function on F, the form 
(vo ty) wu, is a (k,1)-matrix valued form which is the product of the vector 
valued function ror and the real-valued form oj. The form 


% = 2 (ror Joy! 


is of type p. For, clearly a, annihilates any p-tuple of vectors one of which 
is vertical since each w; has this property. Moreover if X,,' : ',X, are 
vectors at é€ P and s€ O(k) we have l 


to (X18, ` +, Xps) — Z ro (£s) r7 (£s) wy! (X18, ©, Xps) 
=s {r (6) Dry (Eo (Xo: +", Xp)} 
ld) | 
where the X:s are the vectors at és which are images of X, by the differential 


of the map é—> és of P into itself. 
We now proceed to prove that «, is n-universal for p-forms of type p. 


Proof: Let P be a O(k)-bundle over a base M of dimension <n and 
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q: PM be the projection. Let (U,) be a covering of M by relatively 
compact open sets such that 


i) each U; is contained in a coordinate cell 


ii) the Ups can be divided into (n+ 1) classes @, in such a way that 
no two Ugs of the same class intersect [4, p. 61]. 


Let W, be a shrinking of this covering, i.e, an open covering W; such 
that W, C Ui Let Dfj=1,: - :,(r+1)} be the union of the open sets 
q> (W) for those is for which U; belongs to B; Let £, be a partition of 
unity with respect to this covering, consisting of non-negative differentiable 
functions ¢; invariant under the action of G with support of £;C D; and 
Il. 

Let a be a p-form of type p on P. It is clear that there exist functions 
(fi, + +, fy") on M whose restrictions to each W, for those ?’s for which U, 
belongs to @;, form a coordinate system on W,. Since « is of type p, a can 
be expressed in D; in the form Na;/g*(dfj), where af are functions of 
type p on D; and dfj=—djj»®- - -Q df. Then it is easy to see that 
a= > Bfq*(df7), where Bf —{,a/ are now differentiable functions on P of 
type p. Let h be a strictly positive invariant differentiable function on P 
such that h(€)* > 2 || B/(é) 87 (4)’ | for every €€ P, where || || denotes the 
norm as a linear operator. (The existence of such an h follows for instance 
from the fact that || 8,'(é)8/(€)’ || is an invariant function on P). We have 


a — D hy g* (dfi) 
where qf = F Bf. Obviously 


POMOLLEEN TO AIAG EFS 


Therefore R(E) =Ir— Enf (E)n (EY is a function on P with values in 
positive definite matrices. Moreover, for s€ O(k) and é€ P, 


R (és) = s’R(£)s. 
For, 
R(és) = — Zins (€8) nf (€s)’ 
= h— Zr’ (Er) 
= HR Xing lE) (EV )s 
= stR (£)s. 


Let 9 (£) be the differentiable positive matrix-valued function on P such that 
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S($)?—R(£). It is clear from the uniqueness of the positive square root 
of a positive definite matrix that S(és) ==s18(&)s for € P, s€ O(k). 

Let y: P>W(n-+k,k) be a G-morphism, the existence of which is 
assured by the universal bundle theorem [6,§19]. Consider the matrix 


AO 


Mae n(€)’ 


oe (y 
y (éS (£) 


where y= with A(I, J) =i. Each » is a (1,k) matrix and y(&)S(é) 
is a (n+ k,k) matrix so that y, (é) is a ((n+i1)nr+4n-+k,k) matrix. 
The map é— y, (é) is a map of P into W (N, k). For, 
(n+1)nP 
y (Ey (E) = 2 mE) (€)’ + SEV YCE YCE) S (E) 

ame (në (€))’ + 8 (8)? 

—I,—R(é) + 8(€)?. 
Hence y’ (E) (£) = Ir. 
Moreover yı: P—>W (N, k) is a G-morphism. In fact, 


ni (és) 
: (sn (€) )’ ni (és) 
mu (és) : : 
yı (és) = i (shimn (€) )’ — nner) ne! (E) S 
Tosar (és) w(é)s-s*S(é)s w(é)8(£) 
y (és) S (és) 
—y.(€)s. 


Finally, we construct a G-morphism ® of P into E such that ®*a,—« 
(E and a are the bundle and p-form constructed in the beginning of this 
section). ®: P>E is defined by mo®—h, mjoð = (fog, + -, frog)’, 
(j=1,-+-,n+1) and ro—y,. © is a G-morphism since y, is so and 
h, fjo= are invariant functions. We then have 


&* (a) = O* (J morfu/) 
= © (10° ®) (7/0) &* (w/) 
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=E houn oro S) O* (wf) 
== X hma, n dtr (dr: - -Q dat) 


where I= (i, ',%) with 1S S&S n. Hence 


3 (a) = F Ana (fiko q) B: + -B Aljo q) =ar 


5. The case of a compact group. In this section we prove Theorem 2 
with @ compact and p any k-dimensional representation of G. Since every 
representation of @ is equivalent to an orthogonal representation, we may 
assume that p==jof where f is a homomorphism G@—O(k) and j is the 
natural representation of O(k) in R*. Let F, be a O(k)-bundle together with 
an n-universal p-form of type j (§4). Let F be a n-universal G-bundle. 
We let @ act on FXE, by (0,6:)9—=(vg,ef(g)), VEF, EE, gEG. 
This makes of F X E, a G-bundle E. Let q, and ga be the projections of 
F X E, onto F and E, respectively. The p-form æo == ga*a, is of type p since 
qa: E— E, is a f-morphism and a, of type j. We now prove that a is a 
n-universal p-form of type p. In fact, let P be a G-bundle over a base of 
dimension Sn and « a p-form of type p on P. Then there exists a O(k)- 
morphism ©, of 7;(P) into E, such that ©,*(a,)—T7;(«). (For the 
definition of Ty see $2). On the other hand, P admits a G-morphism ®, 
into F, since F is n-universal. Let 6: P— E be the map defined by od = 4, 
q2°$—%, 0%, (i is the canonical map P>T,(P), see §2). Pisa G- 
morphism. For, if ¢€ P, se G, we have eae 

(és) — (D: (és), Bao 4 (és) ) 
— (£1 (£)8, a(t (E)F(8) )) 
(98. 
Now 
p7 pa == D? (qa) = (ga 0 D) *a; 
= (P, 0%) Ya, = iy" hy ta, =m ty Tya = g. 


This completes the proof in the compact case. 


_ 6. Proof of Theorem 2. The general case. Let G be a connected 
Lie group and K a maximal compact subgroup of G. We denote by f the 
inclusion map K>G. We seek to construct a n-universal p-form of type p, 
where p is any finite dimensional representation of G. From § 5, there exists 
a n-universal p-form a, of type (pof) on a K-bundle #,. Then the p-form 
%—=T';(a,) on the G-bundle H—T7;(H,) is n-universal for p-forms of 
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type p. In fact, let P be a G-bundle over a base of dimension =n and « a 
p-form of type p on P. It is well known that there exists a K-bundle P, 
such that T,(Pı) is G-isomorphic to P (reduction of structure group to K, 
see [6.812]). We identify P and 7;(Pi) by such an isomorphism. Consider 
the form 4,*(«) on P, which is of type pof. Now let &,: P,>E, be a K- 
morphism such that ®,*(a,) =1,* (a). Consider the G-morphism $—T,(#;) 
of P into E. Then we have 


D* (a) — (Ty(B1)) ao (Ty (1) )*2y (a1) 
= Dy (8*0) — Ty (ta) 


mom J, 


It is clear, referring to 884, 5, 6, that the bundle Æ can be chosen to be 
n-classifying. This completes the proof of Theorem 2. 


Remark. Theorems 1 and 2 hold even when G is a Lie group with a 
finite number of connected components; our proofs continue to be valid in 
this case. 


TATA INSTITUTE OF FUNDAMENTAL RESEARCH, BOMBAY. 
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SYMPLECTIC GROUPS OVER LOCAL RINGS.* 


By WILHELM KLINGENBERG. 


Let L be a local ring, i.e., a commutative ring with unit and a greatest 
ideal /[£L. Then L* = L—I form a group under the multiplication. 
Let V=V(L) bean —%2m-dimensional vector space over L, that is, a free 
L-module with n generators. It turns out that there is, up to equivalence, 
only one non degenerate skewsymmetric bilinear form over V. The sym- 
plectic group over V, Sp(V), is the group of linear automorphiams of V 
which leave such a form invariant. 

In this paper we determine the invariant subgroups of Sp(V). To 
simplify the proofs we restrict ourselves to the case where char(L/I) ~2 and 
L/I£F;. 

If L is a field then Dieudonné [2], [3] has proved that Sp(V) is simple 
over its center, see also Artin [1]. If Z is not a field then there will be 
other invariant subgroups, i.e., congruence subgroups with respect to the 
ideals J in L with J AL and J0. Our principal result, Theorem 3, is 
that there are no other invariant subgroups in Sp(V). 

This conforms with out earlier results on the invariant subgroups of the 
linear and orthogonal groups over a local ring, cf. [4], [5]. Allowing for 
some exceptions which are familiar from the classical groups over a field we 
have therefore established the following feature of the classical groups over 
a local ring: The only invariant subgroups are the congruence subgroups. 


1. General properties of the symplectic group. . 


1.1. Let V—V(Z) be a n-dimensional vector space over the local 
ring L. On V there shall be given a non degenerate bilinear form ® 
satisfying #(X, X) —=0 for all Xe V. Here non degenerate means that the 
homomorphism 


(1.1) de: V>V* 


of V into its dual V* which is given by da(Y)(X) = ®(X,Y) is an iso- 
morphism. We call V, endowed with such a form ®, a symplectic space 
(over L). í 


* Received August 27, 1962. 
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Let V, V’ be symplectic spaces. An isomorphism from V into V’ will 
also be called an isometry. The group of isometries of V onto itself is 
called the symplectic group over V, Sp(V). Sp(V) contains, in particular, 
the identity map: X —> X and the map: X ->—X. We denote these maps 
by 1 and —1 respectively. 

Instead of ®(Y,Y) we also write XY or (XY). If XY—0 we call 
X and Y orthogonal. f 

A submodule U of the symplectic space V is called a subspace if (i) U is 
a direct summand of V and (ii) image (deju: U —> U*) is a direct summand 
of U*. A subspace U is called non isotropic if kernel (deju) —0. 

Let U, U,, Ua be subspaces of V. We say that U is orthogonal sum of 
U, and U, notation, U = U, LUa if U is direct sum of U, and UV, and if 
each vector of U, is orthogonal to each vector of Us. 

If V =F, LV, and o: V— V’ is an isometry of V into V’ then o is 
determined by cı =o | U, and og=o|U;. Therefore, we write o == o, Loz. 


1.2. PROPOSITION 1.1. Let U be a subspace of the symplectic space V. 
Let U° be the submodule of Y annulated by ds(U)C V*. Then U’ is a 
subspace, called the orthogonal space of U. The following does hold 


(1.2) dim U + dim U’ = dim V; U” =U; UND? = kernel (delu) 


Proof. Since (1.1) is an isomorphism ds(U) is a direct summand of © 
V* and hence, U® is a direct summand of V with codim Ọ’ == dim Ọ. From 
U” D U and dimU = dim U% follows U == U. 


Let W be a direct summand of V. Then &(Y)|W=W* With 
this one easily verifies the existence of a canonical isomorphism between 
U*/(ds(U)| U) and U°*/(ds(U°)| U°). This shows that 


de(U°) | U° = image (diej : U’> U°*) 
is a direct summand of U*, i.e., that U° is a subspaces of V. 
Proposition 1.2. Let U be a subspace of V. The following properties 


are equivalent: (i) U ts non isotropic. (ii) U° is non isotropic. (iii) 
V=TLV. 


Proof. Assume (i). Then dajv: U —> U* is an isomorphism. Therefore, 
to each YEV there is a Y€ U with dẹ(Y)| U—dsjy(Yo) € U*, ie, 
Y—Y,€ U’, i.e, we have (iii). On the other hand, if U is isotropic, it 
means that U N V° £0. 
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1.3. An ordered pair {A,B} of vectors in V satisfying AB—1 is 
called hyperbolic. The L-module P == <A, B>, spanned by a hyperbolic pair 
{A, B}, is a non isotropic subspace of dimension 2 ; it will be called hyperbolic 
plane. 

PROPOSITION 1.3. Let U be a non isotropic subspace of V. Then any 
AEU with A=40 mod I can be complemented in U to a hyperbolic pair. 

Proof. The assumptions imply that dejo(A)E U* is an element 0 
modJ. But then there is a BEU with div (A) (B) = BA =— 1. 


THEOREM 1. A symplectic space V is a direct sum of hyperbolic planes. 


COROLLARY. dimV ts even. Any two symplectic spaces of the same 
dimension are tsometric. 


Proof. Since V is non isotropic, dim V £1. For dimV—2 apply 
Proposition 1.3. For dim V >2 we have from Propositions 1.3 and 1.2 
that V =P LP’, P a hyperbolic plane and dim P° = dim V — 2, so that we 

-can argue by induction. 

We see that V possesses a basis Hy, 1 Si S n= 2m, such that {Esju Hos} 
is a hyperbolic pair, for 1=j=m. Such a basis is called canonical. If V 
and V’ are symplectic spaces of the same dimension a linear map Y >V 
which carries a canonical basis into a canonical basis is an isometry, hence 
we have the corollary. 


2. The congruence subgroups. 


2.1. Let J be an ideal in L, JAL. Let V= V(L) be a symplectic 
space over L. The canonical homomorphism gy: L>L/J of L onto the 
local ring L/J determines a homomorphism 


(2.1) gz: V(L) > V(L/J) 


of V(L) onto the symplectic space V(L/J) over L/J formed by the vectors 
gsX, XE V(L), for which ®(g,X,g,F) is given by g,S(X,Y). In putting 
V (L/L) = 0-module we extend (2.1) also to the case J=L. (2.1) deter- 
mines a homomorphism 


(2.2) hy: Sp(V(L)) > 8p(V(L/J)) 


with jogs = gso, for o€ Sp(V). Here, Sp(V(L/L)) shall be the unit 
group £. 
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Let J be an ideal m L. The general congruence subgroup modJ of 
Sp(V), GSp(V,J), is defined as hy! center Sp(V(L/J)). The special 
congruence subgroup modJ of Sp(V), 8SSp(V,J), is defined as Ar"(1) 
= kernel hs. Note: GSp(V,L) = SSp(V,L) =Sp(V) ; GSp(V,0) = center 
Sp(V); SSp(V, 0) =F. 

Let u€ L. Then o(u) denotes the ideal generated by u. Let XET; 
the order of X, 0(X), is the smallest ideal J C L such that gX =0. Let 
o€8p(V); the order of c, o(c), is the smallest ideal J CZ such that 
hyo € center Sp(V(L/J)), i.e., o€ GSp(V,J). Let G be a subgroup of Sp(V); 
the order of G, o(@), is the smallest ideal J C L such that GC GSp(V,/). 
Note: o(X) is generated by the components of X with respect to any basis of 
VY. o(G@) is generated by the ideals o(o), o€ G. 


2.2 A (symplectic) transvection is an element rE Sp(V) of the form 
(2.3) 7A == X+A(AX)u with o(4) =L and uc L 


A is called direction of r. One checks that r is indeed an element of Sp(V). 
A and u are not uniquely determined by 7: (A,u) can be replaced by any 
pair (d'w) EV XL with 0(A’) =L such that A(AX)u—=A’(A’X)w’ for 
all Xey. Note: o(r) Co(w). 


PROPOSITION 2.1. center Sp(V) = {1,— 1}. 
COROLLARY 1. For JAL is GSp(V,J)/SSp(V,/) = {1,—1}. 
COROLLARY 2. Let r be the transvection (2.3). Then o(r) =o(u). 


Proof. Let p€ center Sp(V). Let r be the transvection (2.3) with u==1. 
Then prpt=7 implies pA(pAX) —=A(AX) for all XEV, i.e, pA — Aa, 
where a€ L* may depend on A. Let Be V such that gıA, gıB are linearly 
independent in gV =V (L/I). Then pB=Bb and p(A+B)=—(4A+B)c 
= Aa + Bb. Hence, a=b =c, i.e., pX = Xa with the same a€ L* for all 
all XE V. From (XY) = (pXpY) = (XY)@ then follows a*—1. 


Consider now r, (2.8). Then Ayr € {1,—1} implies o(u) Cd. 


2.3 PROPOSITION 2.2. Let B, B’ be in V with o(B) =0(B’) =L. 
Then B can be carried into B’ by a product of transvechions of order 
C o(B'— B). 


Proof 1. Assume o(B'’— B) =L. If (B’B) € L* then the transvection 


(2.4) 7X =X + (B’—B) ((B’—B)X) (B‘B)* 
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carries B into B’. If (B’B)EI then there is a CE V with BOEL* and 
(B'O) € L*. Then carry by transvections B into C and C into BP’. 


2. Assume 0(B’—B)—J C I. There is a canonical basis E, 1 Sisn, 
with £,—:B. Then B’=F,+ 2H, with ga¢J. Put E, = E? and 
E, + 31E, = Hi, for j>0. For 7>0 define the transvections 


EX + (Bet By) ((Es + By)X)6\( (Bs + By) Bat)" 


(2-5) x —¥—B, (HX) oy(Es(Ev + Bae) )* 


Note that ra is defined also for 2 € I, if we cancel out 2 in the numerator 
and denominator. Now 7’7;,f,J+* = Et, i.e, T]7’py carries E, =B into 
Er == B’. Furthermore, 0(7,) =o (74) == 0(e) C J. 


Proposition 2.3. Let {A,B} and {A,B’} be hyperbolic pairs. Then 
there exists a product of transvections of order C o(B'— B) which leaves 
A invariant and carries B into B’. 


Proof 1. Assume 0(B’—B)—L. If B’Be L* then +, (2.4), gives the 
answer. If B’BEI then rr with X=X-HA(AX), 


rX == X — (B’— A — B) ( (B'— A — B) X) (1 — B'B) ~> 
does the job. 


2. Assume o(B'’— B) ==J CI. Let E, 1Si=n, be a canonical basis 
with F, =—=— B and E= A. Then — B’ == E, + 3E with sc), 10. 
Put E, == HY, E, + 3E = FJ for j>0. Define 7,7’; by (2.5). Then 
Il ry: {£1°, Ea} == {— B, A} > {E ", Ea} = {—B’, A} and o(JI7’7;) CJ. 


THEOREM 2. (First characterization of SSp(V,J)) S8p(V, J) is gene- 
rated by the symplectic transvections of order CJ. In particular Sp(V) 
ts generated by the transvections. 


Proof. From Corollary 2 of Proposition 2.1 follows that S9p(¥,/) 
contains all transvections of order C J. We now prove that a o € SSp(V,/7) 
can be written as a product of transvections of order C J: Let E; be a 
canonical basis of V, put o#;— E’ Then 0(E,—E,)C J. According to 
Proposition 2.2, E, can be carried into E’, by transvections of order C J. 
These transvections carry Hy, i> 1, into E’/, and we have o( B’/ — E4) CJ. 
Proposition 2.3 says that Æ’; can be carried into E’, by transvections of order 
CJ such that Æ’, remains invariant. Hence, {E,,E,} can be carried into 
{E's H’;} by transvections of order CJ. Hereby, <E., E>? will go into 
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<E’ H’.5° such that for the image E’/ of E, 1>2, 0( #/’—F,) CJ. 
Therefore, we can conclude the proof by induction on dim V. 


3. The structure of Sp(V). 


3.1 We will show that the invariant subgroups of Sp(V(L)) are closely 
related to the invariant subgroups of SL(2,L), the special linear group in 
2 variables over L. The invariant subgroups of this latter group have been 
determined in [4], for the case that char(L/I) 2 and L/IAF,. We will, 
therefore, from now on restrict ourselves to local rings L having these 
properties. 


8.2 PROPOSITION 3.1. Let P be a hyperbolic plane in V. Assume that 
pE Sp(V) can be written as p—p|Pi1|P°. Then the invariant subgroup 
Gin Sp(V), generated by p, contains SSp(V,o(p)). 


COROLLARY. The invariant group, generated by a transvecttion 7, is 
S8p(V, o(r)). 


Proof. We denote by SG(2,L,J) the group of linear automorphisms of 
P (considered as a 2-dimensional vector space) which is generated by the 
linear transvections of order CJ, cf. [4]. In particular, 30 (2, L, L) 
= SL(2,L) = group of the special linear transformations of P. Now, since 
dim P = 2, any linear transvection rX = X + Bẹ (X) of P can be written as 
a symplectic transvection +X == X + A(AX)u with B == Au, (X) = (AX). 
Hence, SO (2, L, J) =SSp(P, J) ; in particular, SL(2,L) = Sp(P). 

Under our assumptions, Theorem 3 in [4] implies that S8Sp(P,0(p | P)) 
= 8C(2,L,0(p|P))C G. This means, in particular, that @ contains all 
transvections with a direction A€ P and order Co(p|P)—o(p). Since 
Sp(V) operates transitively on the directions or order L it follows that G 
contains all transvections of order C o(p). Theorem 2 gives the assertion. 
The corollary follows from the remark that a transvection satisfies the 
assumptions made for p. 


3.2. Lemma. Let o€ Sp(V). The invariant subgroup G, generated 
by o, contains SSp(V,o(c)). 


Proof. We divide the proof into four steps. 


(i) Assume cA==Aa+ Bb and ABE L*. Then SSp(V,0(b)) C G. 
Indeed, let + be given by (2.3) withu—1. Then p=rortot¢€ G A and 
B span a non isotropic plane P. Since p=p|PL1|P° and o(p)=o(b) 
we can apply Proposition 3.1. 
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(ii) Assume o(c)==L. Then the Lemma holds. Indeed, there is an- 
A€V with o(cA—A) =L and cA—A,A linearly independent mod I. If 
(cAA) € L* apply (i). If (oAA)EI we can find a CEY with Cod =O, 
CA ==1, as can be seen from making a canonical basis with F, == A. Define + 
by rX == X + (C—A)((C—A)X). um ee G and ey E L*, 
Proceed as above. 


(iii) Let o(e) CI. Ifo(A) =L then SSp(V,0(AcA)) C G. Indeed, 
let {A,B} be a hyperbolic pair and define r by (2. 3) with u==1. Then 


"—=cohorte@and 
d'A =A +A (Acd), eB=B—A-+o"4(A(oeB—coA)). 


Put — (AcA)(A(oB—cA))t=2. 0(2)=0(AcA). Put A+x2B=A*. 
Then o’A* = A*(1— x) + Ba*. From (i) follows that G contains the trans- 
vection rX —=X+.B(BX)z(1— 2)". Therefore, o*=—1'o’€G. o%A* 
= A*(1—z). Define 7* by r*X = X + A*(A*X). Then p* = g*-ir*otr*t EQ. 
With 1 = (A*B) = oc? A*o*B*) — (1— x) (A*o*B) we find p*B = B-+-A*y, 
y= (1—2)?—1, i.e., o(y) =o(z) = 0(AcA). From (i) now follows me 
assertion. 


(iv) - Let o(c) CI. Then the Lemma holds. Indeed, let K be the ideal 
generated by the elements AoA with o(A)—=L. Then K Co(c) CI. We 
will show that K—o(c). Since we have from (iii) that SSp(V,K).c@ 
this will prove the assertion. f 

Let XE V and pE Sp(V). Then we write X and p for ggX and hgp, 
respectively. Assume now that there is an A € V, o (4) = L, with o (z — A) 
= J 4 (0), J C I=—hgI. Here we assume hr ==1. The case hro =— 1 can 
be handled in a similar way, by considering ¢4 +- A instead of si —A. We 
write ¢4 —A = 3Poeiiz, 1S aSr, where the Fa are linearly independent 
modZ and the tia form a minimal system of generators for J, cf. the proof 
of the Lemma in [4]. 

For any C€ V with o(C) =a L we have o(4 +0) = = L or 0(A—C) = 
hence (A -+ 6) (#4 + 50) = 0 or (— Ö)(sA— 50) —0 and therefore, ay 
AA = CoO = 0, Č (g —A) = (GA—A) (FO —6)/2, We now choose a C 
such that CF,—=1, Then this formula yields, with 


OPa = da, Pa (56 — CG) 2+ = tha € Ï: a, (1—,) = ils (Zp — as), 


B> 1. Since 1—#, is a unit in L=gel. this is a contradiction ji our 
assumptions on the ña. a E : 
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THEoREM 3. (Structure of Sp(V)) The only invariant proper sub- 
groups of the symplectic group Sp(V) over V=V(L) are the congruence 
subgroups GSp(V,J) and SSp(V,J), J an ideal AL. 


Here we assume char(L/I) 42 and L/I=£F,. 
COROLLARY. (Second characterization of SSp(V,J)) 
SSp(V,J) =comm(Sp(V), GSp(V,J)) —comm(Sp(V), SSp(V,7)) 
In particular, comm(Sp(V)) = Sp(V). 


Proof. Let G be an invariant subgroup of order o(@) =J. Then 
GSp(V,J) D G. According to the Lemma we have GD SSp(V,0(c)) for 
all c€G. But then, since J is generated by the ideals o(c), o€ G, 
GD SSp(V,J). Since G8Sp(V,J)/SSp(V,J) = {1,—1}, for JAL, the 
theorem follows. 

For the proof of the corollary we first note that the mixed commutator 
groups belong to SSp(V,J); it remains to prove that 


o(comm(Sp(V), S8p(V,7)) =J. 


This follows from the easily verified remark that to a given transvection r 
there always exists a se Sp(V) such that o(r) —o(r 070). 


3.3 Let P: Sp(V)—>Sp(V)/center Sp(V) be the natural homomor- 
phism. Since G8p(V,J)/SSp(V,J) ={1,—1}, for JL, we have 
PGSp(V,J) =PSSp(V,J). We denote this group by PSp(V,J). From 
Theorem 3 follows 


THEOREM 4. (Structure of PSp(V)) The only invariant proper sub- 
groups of the projective symplective group PSp(V) over V =V (L) are the 
congruence subgroups PSp(V,J), J an ideal AL. 


Here we assume char(L/Z) 42 and L/I=£F,. 
COROLLARY (Dieudonné [2], [3]) If Lisa field, PSp(V(L)) is simple. 


Appendix: On the definition of a subspace 
of a metric vector space. 


Let V be a metric vector space (metrischer Vektorraum) over a local 
ring in the sense of [5], 1.1. As Mr. David Schneider kindly pointed out to 
me, the definition of a subspace (Unterraum) U of V has to read as follows, 
ef. [5], 1.1: U is a submodule of V with the following properties: (i) U isa 
direct summand of V, (ii) image (dajy: U —> U*) is a direct summand of U*. 
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It then follows that kernel (ds): U>U*) is a direct summand of U. 
However, this property does not imply (ii). 

All statements in [5] remain true with this new definition of a subspace, 
the only modifications are occurring in the proofs of Satz 1 and Satz 2 in [5]. 
For these modifications compare the proofs of Propositions 1.1 and 1.2 of 


the present paper where we did use the correct definition of a subspace 
already. 
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ON THE EXISTENCE AND UNIQUENESS OF SOLUTIONS OF 
THE POISSON INTERFACE PROBLEM.* 


By D. P. Squire. 


In various physical problems connected with heat conduction, electricity 
and magnetism, and fluid flow, the following problem arises: D is a simply- 
connected two-dimensional domain enclosed by a continuous curve C. A curve 
F, terminating on C, divides D into two domains D, and D,; and C into arcs 
C, and C.. It is required to find a continuous function u in D (the closure 
of D) such that 


i) Vu=fhm D, V’u = f; in D, 
ii) ut on, where @ is a given continuous function on C 
iti) Kéu,/dn == du,/in on FND, K a positive constant, FE", where 
uxt, in Dy, w=u, in Da and the normal derivative is in the 
same direction in each case. 


In the following discussion, a function u satisfying these properties will be 
called a solution of the Poisson interface problem. When fı and f, are 
identically zero, u will be called a solution to the Laplace interface problem. 
The terms Poisson-Dirichlet or Laplace-Dirichlet will refer to the corres- 
ponding boundary value problems without interfaces. These problems belong 
to a class also referred to in the literature as transmission problems. 

. Oleinik [3] and others [5], [6], [7] have proved existence of generalized 
and classical solutions to much more general elliptic equations with similar 
boundary conditions by functional analysis and other methods. The special 
problem above, however, can be treated by means more elementary, viz., the 
iteration method of Schwarz as described in [2] together with the technique 
in [4]. It will be shown here that a solution to this problem exists under 
certain smoothness conditions on the boundary for analytic arcs F and that 
the solution is unique. Both proofs are based on the following maximum 
principle. l l i 


THEOREM 1. If u is a function continuous on D satisfying Vu— 0 
on D: U Da, and öu,/ön— Köu,/ön on FE C?, then the maximum (or mini- 
mum) of u cannot occur in D unless u is identically a constant. 


* Received September 11, 1962. 
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Proof. u cannot achieve its maximum in D,U De unless constant. 
Suppose it achidves a maximum .on F, say at zo Then, if n is the interior 
normal to D, ati ts, we have by Hopf’s theorem [1] #u,/én <0. The con- 
dition on F then requires ĝu,/ðn <0, i.e, on the straight line normal 
through to u is a strictly monotone function in the neighborhood of To, 
contradicting the maximality of u(x). Thus the maximum must occur on C. 
A similar argument holds for the minimum. 


COROLLARY." There is at most one function continuous on D satisfying 
conditions i), ii), and iii). 


Proof. If there are two, say u and v, then w=u—v satisfies the 
hypotheses of Theorem 1 with zero boundary values. Zero is then the 
maximum and minimum value of w on D. Thus w==0 on D. 


Lemma 1. In the interface problem let F be a straight line, D be a 
domain symmetric with respect to that line and one for which the Laplace- 
Dirichlet problem is solvable. Then the Poisson interface problem is solvable 
for D with interface F if f,€C, in D, and f,€ Cy, in Dy, with fı and fa 
bounded on D, and D, resp. (Cp indicates Holder continuity with exponent 
p> 0). Moreover, u, € C1, in D,U Fand use Ct, in DU F. If u™ is any 
sequence of continuous functions satisfying i) and iii) and converging uni- 
formly on C to ü, then im um) u exists and u is the solution of the Poisson 
interface problem with boundary values ù. 


Proof. Assume F is the line y—0. Let w, solve in D the problem 


Pah POHD 
i K in D 
Vw, |a An theta) PE: 


Ki, (p) + ü:(q) 
1+K 


Kü (p) +%:(9) 

I1} KE 
‘Here p is in D, U C, and if p= (z, y), then g = (z, —y). Let w, solve in 
D the problem 








We |p — 
on 0. 
We |a = 





in D 
vl LOEO) 


1} 
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wae ü (p) —ür(g) 
2 1+K . 
: on C. 
ü | ü,(g) — th, (p) 
2 1+K 


These function are. solution to an ordinary Poisson-Dirichlet problem for 
D and this problem can be solved with the help of the Green’s function. 
Both w, and w,€ Ct, in D-and EC? in D,U D, and are continuous in 
D. wa, —y)—w.(z,y) and wol, —Y)=—wolz,y). Thus, Ur = We + Wo, 
Us = Ww, -+ Kw, satisfies i), ii), iti) and gives the solution to the Poisson 
interface problem. u, and tw. have the regularity indicated in the statement 
of the lemma. For the second part of the lemma u™ is decomposed into 
v-+w where v satisfies the Poisson interface problem with zero boundary 
values and 19) satisfies the Laplace interface problem with given boundary 
values 7. With the notation as above 


W) me 19) + 
W = we) + Kw) 


where w,™ and w,(® are harmonic in D. The boundary values of w,” and 
wo) converge uniformly and thus w,) and w,™® tend uniformly to harmonic 
limits w. and wo; and, moreover, the partial derivatives tend.to the partial 
derivatives of w, and w, and uniformly so on compact sub-regions of D.. Thus 
um == » +. w™ tends uniformly to a limit u; and on F, du) /dy tends to du/dy. 
Thus u satisfies the Poisson interface problem. 

Since the Poisson interface problem is invariant under conformal 
mappings, the lemma above can be extended. 


Lemma 2. In the interface problem let F be an analytic arc. If u® 
solves the interface problem with continuous boundary values i, and u® 
tends uniformly to ü, then u® tends uniformly to u and u solves the Poisson 
intreface problem with boundary values ù. 


Proof. By the maximum principle, uniform convergence on the boundary 
implies uniform convergence in the interior. Hence u exists and is continuous 
on D. For the region D, U O, U F, u = v -+w where v satisfies Vr=fı 
in D, with zero boundary values, and w satisfies Y?w) —0 with boundary 
values ü, Now w converges uniformly to a harmonic function w in D, 
and so u==v -+ w. Thus Vuw—f, in D,; and similarly Vu=f, in Da 
It remains to show condition iii) is satisfied. By a conformal mapping, a 
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segment F* of F is mapped onto a straight line and a suitable neighborhood 
of F* is mapped onto a circle having the image of F* as diameter. The 
interface problem is.invariant except that new f, and fz appear. By Lemma 
1, u, € C1 in the upper half of the circle and on the interface and u,€ C* in 
the lower half. Moreover the first order partial derivatives of the sequence 
converge uniformly to the first order partial derivatives of u. Thus the same 
is true under the inverse mapping and iti) is satisfied. 


The existence of at least one solution to the interface problem is- based 
on the following lemma, which is a slight modification of the one proved in 
Courant-Hilbert [2]. The proof will be only sketched. 


Lemma 3. 8, and K, are arcs enclosing a simply connected domain A. 
At the two points p, and p, of their intersection each arc has a one-sided 
tangent and the interior angle between the curves ts B, O < B <2. I, ts any 
continuously differentiable arc in A intersecting I, and S, in pi and ps, but 
meeting each arc in a non-zero angle. K, is a continuously differentiable arc. 
If v is any harmonic function in A, with v =Q on S: and |v|S1 on Si, 
then there is a constant q, O< q <1, depending only on the geometry, such 
that |v|Sq<1 on Sa, 


Proof. If the corner has a non-zero interior angle $, then, with the 
corner point considered as the origin in the complex z-plane, a transformation 
of the form w == 2"/P maps the corner onto a corner of angle ~, i.e., removes 
the corner. The lemma in [2] referred to above is then applicable. (The 
boundary RENA in that proof actually requires that the curve carrying 
the “zero” values has a one-sided tangent at the point where it meets the 
curve carrying the “one” boundary values.) 

Any domain for which the interface problem is solvable can now be 


extended by means of the iteration process of Schwarz. A special case is 
embodied in the following theorem. 


THEOREM 2. Let the interface problem be solvable in D( i.e., there ts 
a continuous function u on D satisfying i, ii, and iii) for analytic F and 
with C, once continuously differentiable. Let D* bounded by C* be a domain 
for which Yv =f, v= on C%, is solvable (1. e., v is continuous on D*). 
Let D* overlap D, and suppose O, C*, F have two and only two points.in 
common, viz., the two points of intersection of F with C. If all curves at 
these points meet at non-zero angles, then the Poisson interface problem is. 
solvable for the union of the domains D == DU D*. 
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a 


Proof. Let a* be the are of C* joining p, and p, which is exterior to 
D, and b* the arc of C* interior to D. Let b be the arc C, of C and a be 
the arc C, of C. It is supposed that b* is once continuously differentiable. 
Boundary values ® are prescribed on a* and a and the Poisson interface 
problem is to be solved in the domain D bounded by a and a*. The problem 
is solved by iteration. Arbitrary continuous values are prescribed on b to 
complete those given on a. Then the interface problem in D is solved, the 
solution being wu). The values of u® on b* are used together with the given 
values on a* to solve in D* the Poisson equation. This solution is u*®. The 
values of u*“ on b are then used to solve the interface problem in D and so on. 
Thus a sequence w® is generated in D and a sequence u*® is generated in D*. 
On b, u! — uw and so uk) — uk) — uh) —u*k) on b. On b*, už) 
== uw) and so wh) — uk) = ur) utk), Let M*, be the maximum of 
| urt —u*® | on b and My the maximum of [utt uF | on b*. Let 


rk) — qt (k) 
M; 





V” = 
in D*. 


Then v, is harmonic in D*, vanishes on a* and |v,*| S1 on b*. By 


2 uk) — y$- 
Lemma 3, |u*|Sqg<1 on b, and so M,*<gM,. Let v, = a= 
k-1 


in D. Then vx solves a Laplace interface problem in D with |v: | =10n 0 
and v,—0 on a. By the maximum principle, | 1 |<1 on b* and so on b* 


| ue) — ut | < My, 


and so My = My". Thus M,*=qM,.*. Consequently M,*, My, tend to 
zero. Moreover the series 
ao 
um p E Lu) — wf] = lim um) 
k=1 n>n 


t 
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is absolutely uniformly convergent (being dominated by a geometric series) 
and so u—limu™ satisfies a Poisson interface problem in D. Similarly 
u" — lim u*™ satisfies a Poisson problem in D*, On b, u*¥® —u® and so 
u=u* on b. On b*, u**) =u and so u*—u on b*. Thus, w—u* is 
zero on boundary b* and b, and harmonic inside; and so consequently in the 
domain bounded by b and pe: u—u* Thus the function w which is u* in 
D* and u in D is the solution. to the Poisson interface problem for D. 

The statement of the existence of the solution to the Poisson interface 
problem is contained in the following theorem : 


THEOREM 3. D isa simply-connected domain bounded by a closed Jordan 
curve C for which a barrier exisls at each point. F is a segment of an analytic 
are intersecting C in two distinct points p, and p, at non-zero interior angles. 
(C, and C have one-sided tangents at pı and pz.) fı defined in D, and fa defined 
in D, are bounded and in the interior of their respective domains are uniformly 
Hölder continuous with exponent p > 0, ù is a prescribed continuous function 
on C. Then there exists one and only one continuous function u on D 
satisfying properties i, ii, ii, of the Poisson interface problem, i. e., solving 
the problem. Moreover, the first order partial derivatives are uniformly 
p-Hilder continuous in compact sub-regions of D, UF and D,U PF. 


Proof. Since F is analytic (even at the endpoints) there is a-univalent 
conformal mapping of F onto a straight line with a neighborhood of F mapped 
onto a neighborhood of the straight line. The Poisson interface problem is 
conformally invariant. ‘The Poisson interface problem can now be solved for 
any region in the image plane which is symmetric with respect to the straight 
line as in Lemma 1. Thus, in the original plane the Poisson interface problem 
is solvable for a class of basic domains. Arbitrary domains as described in 
the theorem can be obtained by adding on to some basic domain other domains 
as in Theorem 2 by use of the iteration process. Thus existence is established. 
Uniqueness has already been proved. 

Existence of solutions may be established for a domain with several non- 
intersecting analytic interfaces by considering it as the union of single-inter- 
face domains with overlapping boundaries and applying the Schwarz iteration 
process. 

Existence may also be established for interface conditions 


K,du,/On = du,/dn, Kan = tg 


where K, and K, are positive constants, since a maximum principle is valid 
here also. For suppose that maxu, occurs at z, on F. Then u, on F has 
F 
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its maximum at zo. But by the Hopf theorem, w.(2,) cannot be the maximum 
of uz over Da. Thus, - : 


u, SS max (max ŭ,, 1/Ka max üz). 
Similarly, an examination of the minimum shows 
Uy = min (min ü, 1/K, min ts). 
The same argument can be used to establish 
| ua | max (max | ŭa |, Ka max | ü |). 


The remainder of the existence proof is the same, depending on the con- 
struction of w, and w, such that u == We- Wo, Us == Kaw, + Kiwo as in, 
Lemma 1. 
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FUNCTIONS WITH A MEAN VALUE PROPERTY IL* 


By LeoroLp FLATTO. 


1. Introduction. Let f(z) be a real valued continuous function defined 
in an n-dimensional region F and satisfying the mean value property (m. v. p.) 


(1.1) fla) = f fe+ty)du(y) for we R, O<t< e 


Here z and y are abbreviations for the vectors (21, ` ',2n), (Yo' °°» Yn)- 
u denotes a positive Borel measure of compact support, Y being the support 
of u and p(¥Y)==1. It is assumed that p is not contained in an n— 1 dimen- 
sional hyperplane. 

We have shown in an earlier paper [8] that the m.v.p. (1.1) is equiv- 
alent to having f(x) satisfy an infinite number of homogeneous partial 
differential equations with constant coefficients. Friedman and Littman [9] 
have subsequently obtained another system of equations equivalent to the 
m.v.p. This system proves to be more convenient to work for the problems 
which we will discuss. The equations in question are 


(1.2) P,(0/82)f— 0 1<j<e) 
where P;(2) = f (eWiduly), sry — aay +: + all 
0/8: —= (3/ðt - +, 8/8ay). 


It follows furthermore from the work in [8] that the solution space F 
of (1.1) is finite dimensional if and only if the system of algebraic equations 


(1.3) Pa) =0 (lSj<e) 
has 0= (0,- - -,0) as its only common complex root. (1.3) is equivalent 


to having SP, (a) a /j!— 1 for all complex 2. Since 
J=0 k 
SPs (oaile f È (eyida) = for duly) 
j=0 Y j=0 r 
(1.3) is equivalent to 
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aa f erd) =1 
' ¥ 
for all complex z. We will use formulation (1.4) in Section 2. 


In this paper, we study system (1.2) and condition (1.3) in greater 
detail; we will occasionally quote results from [8] without proof. In Section 
2 we discuss the “size” of the solution space F. One effective way of doing 
this is by counting for each integer m = 0 the number of linearly independent 
homogeneous polynomials of degree m which satisfy (1.2). Using the work 
of Fischer on systems of partial differential equations [7] and certain results 
by Hilbert on polynomial ideals [11], we show that n distinct cases present 
themselves. We then proceed to illustrate these cases by various examples. 

Condition (1.3) or its equivalent (1.4) seems to be difficult to verify 
even for Euclidean measures of familiar figures. In this direction we achieve 
greater success if we make some simplifying assumptions concerning the 
measure u. In Sections 3 and 4 we consider respectively the following types 
of measures: a) p is a discrete measure, i.e. u(P4) 40 on a finite set of points 
mlS iS N), a0 elsewhere; b) » is invariant under a finite irreducible 
group @ of orthogonal transformations generated by reflections. I.e. „«(TY') 
—p(¥) for any Borel set Y where TY = {z | c= Ty,y€ Y,T E€ G}. We 
refer to @ as a finite irreducible o. g. g. r. 

We consider in fact the following generalization of the m.v. p. 


(1.5) Í, f(a-+ ty)dy(y) =0 for zE R,0 < t< en r(F) —=0. 


where r is a discrete signed Borel measure with compact support Y. We obtain 
a geometric criterion on y which guarantees that the solution space to (1.5) 
be finite dimensional. i 

For case b) we shall require some results of Coxeter [6] and Steinberg 
[15] on the invariants of a finite irreducible o.g.g.r. It turns out that the 
solution space F is finite dimensional and can be completely specified pro- 
vided u satisfies a certain moment condition. This condition is in general 
difficult to verify and in Section 5 we specialize » to be a measure distributed 
over a regular polyhedron of fixed orientation. We thus generalize to n 
dimensions the following problem first studied by Walsh [17] in two dimen- 
sions and then by Beckenbach and Reade [1], [2] in three dimensions. To 
determine the class of functions f(z) continuous in a region R such that the 
value of f(z) at the center of a regular polyhedron in È similar to a given 
one be equal to the average of the values .of f(a) at the vertices. 

The work in [2] is incomplete for the dodecahedron and icosahedron. 
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Using the method of Section 4, we complete this gap in Section 6. We also 
determine in Section 5 for the measures considered there the solution space of 


(L6) fe) = f Tat ty)du(Py) for zcR,0<t<w 


where T is arbitrary rotation (by a rotation we mean an orthogonal trans- 
formation of determinant +1). We will say that these functions have the 
rotated mean value property (r.m.v.p.). 


2. The ‘‘size’’ of the solution space. We employ the following nota- 
tion. The reader is referred to [12] for the terminology which we use here. 
(Pu: > ',P,) stands for the ideal generated by the polynomials P,,- - -, Pr. 
P |Q means that the polynomial P divides the polynomial Q while P{Q 
means that P does not divide Q. With any ideal U we associate its manifold. 
of zeros My and dim % stands for the dimension of X as well as of My. If 9 
is a homogeneous ideal, then hom. dim. W stands for the homogeneous dimen- 
sion of X (= dim. %—1). Hom. dim. Y —— 1 if and only if My consist of 
O == (0,° > +, 0) only; we say in this case that X is trivial. ([12], p. 103) 

We will need the following two theorems on polynomial ideals duc to- 
Fischer [7] and Hilbert ([12], pp. 161-165) respectively. 


THEOREM 2.1. Let A be a homogeneous ideal of polynomials in the 
variables Tı,’ ``, Let F be the space of polynomials p(x) satisfying the 
system of partial diferential equations a(0/dx)-p==m0,a€ A. Then the vector 
space Vm of homogeneous polynomials in n variables of degree m is the 
direct sum of the vector spaces A, and Fm where Am =X A Van, Fn = FO Van 
Symbolically V m = An ® Fy. ` 


THEOREM 2.2. Let H(m;, X) = dim Fn — dim A, where dim V,,, dim A. 
stand respectively for the linear dimensions of Vy, and An; let d= hom. dim. A. 
Then for sufficiently large m, H(m; X) = homt + hım®™ +--+ -+ ha (h > 0). 


If d=—1, then the above statement is to be interpreted as saying 
that U contains all homogeneous polynomial of sufficiently high degree. If 
H = (6° *,¢r) where d=n—r—1 (r<n) and ¢ is a homogeneous 
polynomial of degree d; (1Sı=Sr), then hp ~a,a,- - u, for m>a,+-- ~ 
+ ar — n. a 

The last statement in Theorem (2.2) implies the following: 


COROLLARY. Suppose M == (dı, —, pa) is a trivial ideal, the o/s being 
homogeneous and y=deg& (1Si& n). Then the linear dimension of 
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the residue class ring R/U is aa: + -an where R denote the ring of poly- 
nomials in Tı, £a '`,2p Furthermore X contains all homogeneous poly- 


nomials of deg > $ u— n. 
i 


Proof. Let B= (pu: pni). By Theorem (2.2) 
n-1 


A (m, 8) a0: ` ana for m >N =$ an. 


i 
Now H(m; X) =H (m; 8) —H(m— an; B) ([11], p. 158) (By definition 
H(m;8)—0 for m<0). In particular H(m; A) =0 for m >N +a 


n. ae 
== Syn. Hence 
421 


Ntan 
dim R/H == 3 dim(m; 2) 
m=0 
x Nia, Naa 
= % dim(m; 8) — 3 dim(m— a, ;B) 
m=0 m=0 


N+, N 
= > dim(m;8) — % dim(m;B) 


m=O m=0 
N+, 

= > dim(m;B) == ga: ` am. 
meN+1 


Combining Theorems (2.1) and (2.2) we obtain the following result. 


THEOREM 2.3. Let g(m) = dimension of the space of homogencous 
polynomials which satisfy the m.v.p. (1.1). Let d=hom.dim. 8 where P 
is the homogeneous ideal generated by the polynomials P; (1S jo). 
Then for sufficiently large m, g(m) is a polynomial of degree d. 


Every solution (1.1) or its equivalent (1.2) can be expanded into a 
series of homogeneous polynomials which themselves satisfy (1.1), this being 
so as P,(0/ér)  f=0 is an elliptic equation. We thus see again that the 
solution space F of (1.1) is finite dimensional if and only if d =— 1. 

We note that in previous work on the m.v.p. problem ([4], 8.9) the 
emphasis was on whether the solution of (1.1) form a finite or infinite dimen- ' 
sional space. We now see that the case of an infinite dimensional solution 
space should be divided into n—1 subcases so that in general n possibilities 
present themselves as d may assume any of the n values — 1 S d4 S n— 2. 

The following theorems concern themselves with the calculation of hom. 
dim. P for certain types of measures. We introduce the following notation. 
G= XX: -X G, is the group of orthogonal transformations with 
matrix representation 
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T, ) 
T: 


Tr 





EJ 


$ 


where.the elements not shown are zeros, and where T; (1SjSk) is an 
arbitrary orthogonal matrix of degree d,. E is the identity matrix of degree _ 


k+1 


dris 2a =e G is thus the direct product of the orthogonal groups G 


ais =, is < k); G; acts on the variables Ts, a, < sa), where 


aj; =d, +d: +: +4, S= 8 (r1) X 82(r2) X — X Sa lrn) 


denotes the direct product of the spheres $4(r;): > tSr? (1SiSk) 
where ha + d+: +den eo. 

We can now state the following result. 

THEOREM 2.4. a) Let p be invariant under the group G. „Then hom. 
dim.P = > di—k— 1. 


b) Let u denote the Euclidean measure of S divided by the total mensure 


of S (normalized Fuclidean measure). Then hom. dom. X = n — k—1. 


Furthermore if f(x) satisfies the m.v. p. 11.1), then f(a) is BIT 
in the variables t, (yı <sSa,1Sj=k). 


Proof. a) let T be an arbitrary rotation of the group G. Then 
Pa(Te) = |, (2,9), du) — f° (E Ty)” duly) 
(2.1) Senn =f (ey) duly) Pale) 
(lim<o). 
Thus Pu (2) is an invariant of the group @. It follows ([18], p. 53) that 
Pnisa polynomial i in p, °°, px, Vana,’ © y Tn Where p? = x te, 1SjSk; 


s=aj+1 
say 
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(2.2) - Palt) = Qu prs’ -P3 Terns © * Bn) 

Hence Pa) = 0 on the manifold M: pp=0 (1S j S k), u —0 (u. << sn). 

Since hom. dim. M -$ d;—k—1, it follows that hom. dim. % > dj—k—1. 
b) Suppose that P„(2)—=0 (1Sm<o). As shown in Section 1, 

this is equivalent to (2.3) Í e©'Ydu(y) =1 for all complex z. But 

B= Hı X ua X’ "X ur where A is the normalized Euclidean measure of the 


ai 
sphere X z =1. Hence 


3=a;-1+1 
k . 
(2.4) Sera fr dal) 
8 ja Js 


where Xj, Y; denote respectively the vectors (Tajan °°» Za)» (Yaja °° Yas) 
A direct computation yields 


(2.5) SE) = Bey(V= Tape) 


where q; = d;/2 and 
Bele) — AUENA 


Jq(z) denoting the Bessel function of order g. Hence 


k ponen 
(2.6) f er daly) =Ú Ba (Vi reg) 
8 j=l 
Thus (2.3) becomes 
(2.12) TE Ba (V—i ree) 1) 


for all z. Since By,(pjz) has zeros for p5>£0, it follows that (2.7) holds 
if and only if pp—=0 (1=j=k). Thus the manifold Mẹ, is given by 


p? =p? =: + == px*—0 so that hom. dim. p =n—k—1. Since p70 


on Mp for 1 & j £ k, we conclude by Hilbert’s Nullstellensatz (see [12], p. 47) 
that there exists a positive integer N so that pPNEB (1Sjk). This means 
that pP (s) (17k) is a linear combination with polynomial coefficients 
of the. P,,(z)’s. Substituting in this identity 0/9r for z, we conclude that 
pf (8/82) f—0 (137k) so that f is polyharmonic in the variables 
Dayar = "Ta; (1 = j = k) : 
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We notice in particular that if d;—-—1 (1=j=&), then hom. dim. p 
= — 1 so that solution space is finite dimensional when S is a parallelopiped 
and p is the normalized Euclidean volume. We will return to this ee 
in Section 5 were we will obtain some additional results. 

As a final illustration, we characterize the solution space of (1. 1) when 
p is invariant under the group G — G, X Q; where G,, G are the orthogonal 
groups acting respectively on the sets of variables (zı,° * -,2n1),2n. We set 


Ars fy duly), dam Sm), d= f vit duly), 
Ane Í, Yı'ya? du(Y), An got du(y) | 


and 


(4) = Ax Ais? — Á n4141 + AgsA 10, 
w= o(p) = Í, ys? du(y)/ f Yn” dp(y). 


We assume that the region R is z„-convex 1; i.e. any line joining two 
points of R and parallel to the z,-axis is contained in Æ. This assumption 
is made in order to avoid any multiple valuedness for the functions to, th 
introduced in the next theorem. We state the following result. 


THEOREM 2.5. Let u be invariant under the group Gi xX G, and 
suppose that c(u) 40. Then the solution space of (1.1) is given by f(x) 
Vto Vu 


a Wo 





= Uo F UrTy — w Ta? where w= u(t: ` ,2%u1) (i= 1,2) 





are arbitrary biharmonic functions and V 30/802. If p is the nor- 
malized Euclidean volume of the cylinder C: Zear, a]sh wa 
h>0) then c(x) 0. 

Proof. » remains invariant under the transformation yf —— y; y= 
(j1). Hence f, Y1: + + Ya du(y) = 0 if any of the aps is a positive odd - 


integer. It follows that Pa (£) =0 (1Sj<o). A direct computation 
yields : 


# 
(2.8) ` Pyl) = X App 3 Mr, 2% 
k=0 


where p?—=2,7-++---+2,,7, Eliminating p?-between P, and P, we obtain 
ck) 
Ant 








“(mod P:(x)). Suppose now that c(a) #0; then (Ps, P,) 
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== (Pa, Trt). It follows from (2.8) that PaE (Pa £) (1Sj<o). Thus 
P= (Po, %,*) 80 that system (1.2) is equivalent to 


| (AV + An) Ft 
(2.9) pP 
FR] fe 0. 
‘We conclude from the second equation in (2.9) that 
(2.10) f (2) = Uo + Ute + Uatn? + Us? 
where vl, m) (0458). 
Substituting (2.10) into the first equation of (2.9) we obtain 


(2.11) (Aio Vuo + 2A) + (Aro Vt +3 Arte) Ta 
+ (Ay Vta) fn? + (Ay V Ua) En? =Q. 
Setting the coefficients in (2.11) equal to zero, we obtain the desired result 


Vu 
3! 


8 


(2.12) fa) tp + yt —o VP ny 


21 
where Vo = Vin = 0. 
We must still show that c(a) +40 when p is the normalized Euclidean 


-1 
measure of the cylinder C ‘Soe s.r, |z |Sh. In this case the Ay’s are 
pe 


all Dirichlet integrals and can be computed explieitly ([19], p. 252). We 
list the computed values 


r? h? 
Axo ni? Ax = g? Aso = 





Ly? — w 





8r* A Qr?h? A ht 
CESCE T S BS 
Substituting these values into the expression for c(„), we obtain 


2(n-+ 8) 
eH) ES EES 





ht £0, 
8. The case of discrete measure. We proceed to study the solution 
space of 
(3.1) f fle + ty) dv(y) =0 for sE R, 0< t< es 
Y 
where (Y) =0, Y being the support of the signed Borel measure v. The 


following theorem shows the connection between (3.1) and the system of 
equations. 
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(3.2) P,(0/8x) f=0 (lSji<o) 
where P,(z) = S, (z’y)!dv(y). 


THEOREM 3.1. Let f(z) be an analytic solution of (3.1). Then f(x) 
satisfies (3.2). Oonversely if f(x) satisfies (3.2), then there extsts a sequence 
of O” functions fu(z) (n=1,2,: - -) which satisfy (3.2) such that the fws 
converge uniformly to f on every compact subset of R. 


We omit the proof to the above theorem as it is identical with the proof 
to Theorem (2.1) in (8). We just mention that we may define f,(z) as 


fa(t) — fèn (z —y)f (y)dy where 
. ae (cero 

8, (2) = |z ]?—1/n 

0 ‚ |2]>1/n 


), las Verf FR Sn 


ĉ„ is a positive constant so chosen that f alee 1. 
[al S/n 
We have the following 


COROLLARY. The solution space to (3.1) is finite dimensional if and 
only sf the system of algebraic equations (3.2) P;(z) =0 has 0 = (0,- -:-,0) 
as its only common complex root. 


Proof. If P;(2z)=0 (1Sj<) for some 2540, then Re(z-x)” 
(1m <œ) is an analytic solution of (3.2) and thus a solution of (3.1). 
Suppose 0 is the only common root of P;(z)—0 (1S j<o). As in (8), 
any C@ solution of (3.2) is a polynomial of degree < K, K being a positive 
integer determined by system (3.2). By Theorem (3.1), f(z) can be 
approximated uniformly on compact subsets of & by polynomials of degree 
<K. It then follows from a standard result that f(x) is a polynomial of 
degree <K. The same reasoning as in Section 1 shows that (3.2) is 


equivalent to (3.3) Í er®'vdy(y) =0 for all complex z. 
o l Y 


Let us suppose now that » is discrete and concentrated on N points 
Yo’ cyx Where v(y;) =y (1Sj=SN), v=0 elsewhere. (3.1) thon 
becomes 


N 
(3.4) > vif (a + ty) = 0 for ce R, 0<t< es 


The following theorem includes a result found in (9). 


[i 
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THEOREM 3.2. The necessary and sufficient condition that the solution 
space of (3.4) be infinite dimensional is that there ewist an non-zero real 
vector u such that v(P,) =0 for all real c. Here 


Pom {2 | uti: +++ Uta = C}. 
Proof. Suppose that there exists a non-zero real vector u such that 


v(P,) =0 for all real c. Let u'y, (1=j=N) take on the distinct values 
dy," täy Then 


Solu (e+ ty) = (u- a+ ta,)™v(Pa,;) =0, (i<m<wo) 


so that (w-z)” is a solution of (3.4). The solution space of (3.4) is thus 
infinite dimensional. 
Conversely, let the solution space of (3.4) In infinite dimensional. By 


the corollary to Theorem (3.1), it follows that See ss —=() for all com- 


plex z and some z5£0. We may assume ihat. u= Res#Æ0. Let u'y 
(1Sj=N) take on the distinct values a,‘ * *, ar. Then 


N K 
2 jelt VIZ = 2 v (Paj) Q(z) 


where Q,(z) = -È e(ai+tbsr)s and where the b/s are real and m +" + nr =n. 


Since the Qys “as j<<K) form a linearly independent set of functions, 
v(Po,) =0, (1SjSK). v(P.) =0 for cAa, (1SjSXK), 7 in that 
case P, contains no y; Hence v(P,) =0 for all real c. 

As an example of an infinite dimensional solution space to (3. Drg con- 
sider the m. v.p. i 

f(t. + ty Ta + ty2) — F (ts + tyi T2) — F (tr, Ge + tye) + f (tr 22) =O 

where Tı, Ts, t take on all real values. It is well known that the solution 
space is given by the functions f(T, £2) = g (21) + h(z2), g and A being 
arbitrary continuous functions. The measure » is concentrated in the two 
hyperplanes P, (zı =0) and Pa (tı == 41). 

It is shown in (10) that if f(z) satisfies 


(3.5) f(t) = Sut (e+ ew), y>0 (15759), Iu-1 


and if the y/s are not contained in a hyperplane, then f(x) is a N 
of degree < N(N—1)/2. It will be shown in Section 5 that this bound is 
sharp and is attained when the ys for N vertices of an (—1) dimensional 


8 
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regular tetrahedron, a„{y)=1/N (1Sj5N). When the N points y; 
(1Sj=N) are situated in two dimensions we get the following stronger 
result. 


THEOREM 3.2. Let 
N ; N 
(8.6) f(«) =È mf e+ ty), y>0 (1Sj=EN), Pee 


Here v= (1,02), Y= (Yj, Yj) ; it is assumed that x is not contained in a 
line through the origin. Then f(z) is a polynomial of degree = WN. If 
wy 1/N (1S j S&N), then there exists a polynomial solution of degree N 
to (8.6) if and only if there exist a non-singular matrix A such that 

(3.7) Ay; =r (1Sj5N) 


where the vps are the vertices of a regular n-sided polygon whose center is 
at the origin. 
Before establishing this result, we prove the following. 


Lemara. The solution to ‘the system of equations 
N ' 
(3.8) Dt 0 (1SkSN—1) 
j=l 
is given by (3.9) g= Cer O/N (1S 7S N—1) where C is arbitrary and 
o(j) is a permutation of 1,---,N. 


Proof. Using the Newton identities ([16], p. 81 exercises), we establish 
readily that the equations (3.8) are equivalent to the equations . 


(3.10) ox(z) =0 (1Sk=N—1) 
where 
on (2%) = > A" y Sy 


ILL HSN 
Now 


N 
II (2 — z) = ZN — g,gN-1 + opg- — + , "+ (—1)Yoy. 
4=1 

If or=0 (1ISk<N—1), then 

N 
(8.11) II («— z) = 2N + (—1)Noy 


so that (3.9) holds with CN = (—1)N*!oy. Conversely (3.9) is clearly a 
solution of (3.8). i 
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We now proceed with the proof of Theorem(3. 2). 


Proof. We may assume that P,(x) =0 for otherwise the solutions to 
(3.6) are linear functions [4] and there is nothing to prove. P,(x) is a 
positive definite form, say P(t) = Az? + Bra, + Cz. Suppose that 
Paf Pu for some M>2. We claim that p(x) € (Pa, Pu) whenever p is a 
homogeneous polynomial of degree s > M. For choose a linear transformation 
t= Te’ such that 9, (2) = P,(T2’) =? +25”. Since z? = v? (mod Qe), 
Qul) = Pu(Te’) == Dr, + Er -r ; since QT Qu we have D? + E? 40. 
Let X = (Qz, Qu). We have 


(3.12) x M- (De! + Hz’) =0 (modA). 
Multiplying the congruence (3.12) by Dz, — Ex,’ we- bave 
(8.18) 2/4 (Der, ? — Bgg?) = (D? + H*)2,/44—=0 (mod) 

so that z/ ARTEN. 


If E == 0, then we conclude from (3.12) that x,’ € W; hence x,/a,’ € U. 
If #540, then we multiply (8.12) by z’ and conclude from (3.13) that 
tMr EY. Since either ir == + ga (mod) or 


Na + rt, (mod Y) 
we have a, 2, "=0 (mod A) whenever j,+ 7,2 M@M+1 or 
(3.14) q(2’) =0 (mod A) 


where q is any homogeneous polynomial of degree >M. Substituting 
x == T>’ in (3.14) we obtain the desired conclusion. 

To prove the first part of Theorem (3.2) it is then enough to show that 
Paf Pm for some m& N. For it would then follow that M(x) EB where M 
is an arbitrary monomial of degree >N. This in turn implies that all 
partial derivatives of f(x) of order > N are zero so that f(x) is a polynomial 
of degree SN. But P.f P, for some m<N is equivalent to saying that 
the only zero common to 


(3.15) Pal) = Ente y)” (I<Sm<N) 


ise—0. Let b,,- + ',bx be the distinct non-zero values of t'y; (1 Sj SN), 
if there be any such values. 


(3.15) may be rewritten as 
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K 
(3.16) È broy G&mSN) 
fal 
where aj >0 (1<j=K). But the first X equations of (3.16) have a non- 
zero determinant so that a,—=@,—=: : ‘==a@,==0, which is a contradiction. 
Hence 
(3.17) z-yj—=0 (1Sj<N). 


Since the Y’s are not all contained in a line through the origin, the rank of 
(3.17) will be two so that 20. 

UP, | Pm for some m < N, then all solutions of (3.6) are polynomials 
of degree < N. If Paf Py and Pa | Pm for 2 <m <N, then Pm (see Section 
2 for definition of py and Vy) consists of all P ==P,R + cPy where R is 
homogeneous of degree N— 2 and c is an arbitrary constant. Thus dim $y 
== (N—1)+1=N and by Theorem (2.2) dim Vy == (N +1)—N=1 
which means that (3.6) has a polynomial solution of degree N. Hence (3.6) 
has a polynomial solution of degree N if and only if P, | Pm (2S mS N—1); 
iva, if and only if 
(3.18) Pn(z) =0 - (AsSmsN-—I) 


has a solution 7540. 
By the Lemma (3.18) is equivalent to 


(3.19) wi ysa ly ASSN) 
where &,''+,ĉy are the N N-th roots of a fixed number £. Letting 
z= u + iv, this means that 
f i u: y; = Re(¢;) 

a Gye 

Let A be the matrix whose first row is u and whose second row is v. 
Since P(x) is positive definite, x cannot be a constant multiple of a real 
vector. This means that u and v are linearly independent vectors so that A 
is non-singular. (3.6) will thus have a polynomial solution of degree N if 
and only if (3.7) holds. l o. 

We remark that we have not been able to find a sharp bound on the 


degree of the polynomial solutions of (3.6) when the dimension is greater 
than two. 


GSISN). 


4. The case of measures which remain invariant under a finite irre- 
ducible o.g.g.r. Let G be a group of orthogonal transformations and 
suppose that the measure „ is invariant under G. Let TE G. Then 


ee J, TEn") = f, (e Tydal) 
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= fe nrautıy) = J (2-9) "du(y) = Pa (2) 
GS <m<o ) 
RERA Pm(z) is an invariant of the group G for 15& m <œ. We specialize 
G to be a finite irreducible o. g. g.r. Coxeter [6] has enumerated these groups 
and has furthermore made the following observation concerning their invar- 
iants. Suppose that the group @ acts on n variables T1,* * *, 2a. Then there 
exist a set of n algebraically independent homogeneous invariants 


Q. (2) — 3.20, Qa (2), . *, Qn(z) 


of respective degrees dd," u (2= d; <d <`: <da). Every 
invariant polynomial is a polynomial in Q:(7),-: -,Qn(z) ([14], p. 288). 
The degrees satisfy the following two relations ` 


114-9, g— order of G 
421 
(4.2) 


> OR n=r, T= number of reflections in G. 
4=1 


We quote the following result of Steinberg ([15]) which we will: use 
later on.: 


THEOREM 4.1. Let G be a finite 0.9.9.r and suppose Ri, > +, R, are 
the reflections in G with the respective reflecting hyperplanes L,(z) —0 
(lStsSr). Let Q(T), : ',Qn(z) be a basic set of invariants for G. 
Then the solution space of 


(4.8) 949/82) f = 0 (1<i<n) 


is given by the linear combinations of the partial derivatives of TI H(z). 
4=1 
The dimensionality of the solution space equals the order of G. 
Before stating our next result, we require the following. 


Lemma. Let M= {2 | Q(t) =—0,1StSk}. Then Myn is a proper 
subset of My (1SkSn—1). 
Proof. The above will certainly be proven if we can show that dim M+ 
> dim Mr. In general we have dim Mr, — dim M, or dim Mgr. — dim M, —1 
(12, p. 112). Clearly dim M, =n— 1. Since 0 is the only common complex 
zero of Qi(z),- © +, Qa(£) ([14], p. 288), we have dim M, — 0. 
` Since dim M, =n— 1, dimM,—0, we must indeed have dim My 
— dim M,—1 (1I<Sksn—1). Thus Mwn: is properly contained in M, 
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and we may choose ĉr == (Lin °°, fim) E€ Mp1—M, (2 SkSn). Consider 
now the polynomials Pa (z),' + < Pa (£). Each of these is an invariant 
and hence a polynomial in Q:,---,Qx- Since deg Pa = deg Q (1Sj=n), 
Q; must appear as a linear term in Pd, I.e., 
(4.4) Pa(2) = Fy(Q1(2)5* © +> Q (2)) + 6)9;(2) (875%) 
where F; is a polynomial and c; a constant. 

Substituting &; for x in (4.4) we obtain 


(4.5) Pa (t) = J (6-9) duly) = oA). 
Y 
We now stipulate that p satisfies the following moment condition. 
(4.6) f, Cned) #0 e<j<n) 


Condition (4.6) implies that 440 (?<Sj<n). Using (4.4) and a 
straightforward induction on j, we conclude that 


l (Pas’ ` Pan) = (Qu. s Oa) 


Since Pn(2) 1SmSw) is an invariant, we have P„E(Qu° : `, Qa) 
== (Pa © +, Pa) 80 that B— (Pap ` +, Pan) System (1.2) is thus equi- 
valent to (4.3) if we stipulate condition (4.6). We summarize the’ abovt 
discussion as follows. 


THEOREM 4.2. Let G be a finite irreducible o. g.g.r. and let Ry, --, R, 
be the reflections of G with respective reflecting hyperplane L,(x) =0 
(lStsr). Let p invariant under G and let it satisfy the moment condi- 
tion (4.6). Then the solution space of (1.1) consists of the linear combina- 


r 
tions of the partial derivatives of J] Lı(z). The dimensionality of the solution 
= i=1 
space equals the order of G. 


We remark that the last statement of Theorem (4.2) also follows from 
the corollary to Theorem (2.2). 


5. The regular polyhedra. As we had already mentioned in the intro- 
duction, the moment condition (4.6) seems rather difficult to check, even for 
simple measures. In the ensuing discussion we limit ourselves to the case of 
regular polyhedra. I.e, we wish to determine the class of functions f(z) 
continuous in a region # such that the value of f(x) at the center of a regular 
polyhedron similar to a given one equals the average of f(x) with respect 
to a measure distributed over the polyhedron. As is well known, there are 
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only three regular polyhedra in n dimensions. These are: the n-dimensional 
tetrahedron, the n-dimensional octahedron, and the n-dimensional cube ([5], 
p. 186). With each of these figures we associate the group of orthogonal 
transformations which leave the figure invariant. The cube and octahedron 
are duals of each other and are thus associated with the same group. We call 
the groups which leave the tetrahedron (octahedron) invariant the tetrahedral 
(octahedral) group. Clearly these two groups are generated by reflections 
so that the problems of this section are specializations of those considered in 
Section 4. 

For each of the above mentioned figures, there are three natural m. v. p.’s 
which present themselves. 

a) The vertex problem: p(Pi)=1/N (15+) where pi, po, ' +, py 
denote the vertices of the polyhedron, p»<=0 elsewhere. ` 

b) The volume problem: p is the normalized Euclidean measure of the 
solid polyhedron. l 

c) The surface problem: a is the normalized Euclidean measure of the 
surface of the polyhedron. 


It is easy to see that b) and c) are equivalent. We therefore just con- 
sider problems a) and b). Walsh [17] has treated the vertex problem in two 
dimensions. Subsequently, Beckenbach and Reade [1], [2] have treated the 
volume problem in two dimensions and the vertex problem in three dimensions. 

We adopt the following notation. For a given sequence of indices 
(each = 0), 
a= (a, m), |a| =A, + tm, Alea! al, rtm aye zen, 

We first state the following lemma used in the sequel. 

Lemma. Let Fy(r) == X z and ol) = 2, FR FIR 

lal=x 1ENLJL LIAN 
Then (Fi Fat + e, Fn) = (an0a + on), (Sin). 


Proof. We claim that 
(5.1) Fi— aia + ofi + (Loa (lsstSn) 


s 

For consider any monomial Taft: > Tn, j,>0 (lSrSh), i= h<i 
rl 

<'<m It will occur in h= Fi— oF t: + (—1)4o, with the 


coefficient 
-() + Qa de 
Hence G;—0. . 


264 LEOPOLD FLATTO. 


The lemma may now be established by induction on +. (F1) = (01) as. 
F,—o,. Suppose (Fa: © +, Fia) = (01° * *,041). We conclude from (5.1) 
that FE (o1,° © +, 04), 4E (Fa: + +, #4) so that (Fa: - "s Fy) = (o1,° + +, 0%). 

We proceed to discuss the m.v.p. for the above mentioned figures. 

The n-dimensional tetrahedron. This figure can best be described 
by imbedding it in n-+1 dimensions. We assume that the n-+1 vertices 
Py’ "Pan are given by m= (Pay** "> Pon) Where pu-=n/n +1, 
py=—1/n+1 (ij). Without loss of generality we assume fEÜ*; 
otherwise we first reason with falz) — ff(t—v)&(v) dv where &(v) is 
defined as in Section 3 and then pass to the limit by a standard argument. 
We furthermore assume that (5.2) f(x) is constant along lines parallel to 
e==(1,1,--+,1). Le, Q(0/dc) f=0 where Q(z) = £, + ta +: + Tmi 
‘The m.v.p. (1.1) is then equivalent to 
(5.8) Pp (8/00) f —=0 (2<m<o) 


where P„(z) - Í, (z’y)"da(y). Let z= y+ e/n4-1. Then 


Pa() = Í (2.2— 2: e/n -+ 1)"”dy (2) = f (2+ 2)"dy(2) (mod Q (2) ) 
where y is the normalized Euclidean measure of the set Z : z1 +- - "H tn =Í, 
420 (1SiSn++1). Thus 
(5.4): Palt) =1/n4+ 1a +: + oa] (mod. Q) 
for the vertex problem and 

a al es 
(5. 5) Pr Ge: 2 . (mod Q) 


for the volume problem. Now 


a! alVn+1 1 
(5.6) S, wo - ee 
where o is the Euclidean measure of Z. ([19], p. 252) Hence 
(5.7) Pn(2) a Fn(). 


We conclude from the lemma that (Q, Pa: > -, Pai) = (0903 ° yon). 
Since Pal?) (e¢Sm<o) is symmetric in 2,%%,'" ",Zyı we have 
PaE (03° © tyon) = (Q, Pat + +,Pair). ‘Letting ® denote the ideal 
aise by Q -and Pa pea. we have P= (01 ` *,0mı1). As 
01,02," ' ",0nı form a basic set of invariants for the tetrahedral group, 
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we conclude from Theorem (4.1) that the solution space of (1.1), both for 
the vertex and volume problems, is given by the linear combinations of the 


partial derivatives of JJ (m— z). 
It<janel 


The n-dimensional octahedron. We assume that this figure has the 
vertices (1,0,- - -,0), (0,1,0,---,0),---,(0,---,0,1). The vertex prob- 
lem is treated in [9] and we conclude it here for the sake of completeness. 
We have 
(5.8) {Paw(2) -1/nlz + +] (ISm<e) 

: | Pam (2) —0 


for the vertex problem while 
Qn (2m)! f y’eay 
L 
Pan(2) = 7 a)! 


(5.9) 


N 

for the volume problem. Here Y denotes the set Yy sl, 420 (1SiSn) 
4-1 

and V, denotes the volume of the octahedron. Now 


: 2a)! 

(5.10) Sr en . 

([19], p. 252) Hence 

(5.11) Pal an F(z) Gees 


where g? == (247,- + +, a7). 


It follows from the lemma that (Pa, Pa ' © +, Pan) = (01 (2°), + +, on(27)). 
Since Puls) (1Sm<o) is a symmetric function of 2,3, - m, 
P= (o (2°), + +, 0n(27)), 01 (27), 03(2*),* - -,0n(2") form a basic set of 
invariants for the octahedral group and it follows from Theorem (4.1) that 
the solutions of (1.1) are the linear combinations of the partial derivatives 
of 2,0% II (af). 

g ISi Lj <n 

The n-dimensional cube. We pursue the method outlined in Section 4. 
We choose o,(2?),- - -,o,(#?) as our basic set of invariants. We furthermore 
choose 


(5.12) Cum (e°FH/E, 2rtik. . - ort). - -,0) (2SkSn). 
Let é= etik, (17k). Condition (4.8) becomes 
(2k)! 





(5.13) a 2 (2a)! £0 
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for the vertex problem and 
Eu (2k)! 
(5.14) = È, Ga F1! E0 


for the volume problem. 


We have not been able to prove either (5.13) or (5.14) and we limit 
ourselves to the following partial result concerning a and Ax. 


TurmorEM 5.1. Let 2k—1—p* where p is a prime. Then (5.13) 
holds. Let 2k+-1—p where p is a prime. Then (5.14) holds: 


Proof. We have 
(5.16) nit OEY 





where >” includes only those a’s for which ,<k (1=Sj=k) a, is an 
algebraic integer and since it is symmetric in the £s, it is a rational integer. 
we will show that p | >’. Since pfk, pfas and thus 4,340. To show that 


! 
p| SY, we consider the highest power M of p which divides oa where 
<k (1SiSk). This number M is given by ([13], p. 90) 


(5.16) ML ([2b/p/]—(LBad/p!] + + [2au/p!)} 
Now : 
[2k/p*| — ([2a/p*] + + [2ax/p*]) = 1 
while 
[2k/p*] — ([Ra/p*] +: + [2hx/p*]) 2 0 (1Sj<s). 
Hence M = 1, which means that p divides every term in >’ so that p | >’. 
We prove the second part of Theorem (5.1) in an analogous fashion. 


We have ; 
(EHE +-2)- BR (2 +2): 3k HN EY ge 
(2a+1)! 
where $” includes only those a’s for which a; < k (1S jk). The same 
reasoning as before shows that $y is an integer divisible by p so that 6,540. 
If a, 40 (<k <n), then it follows from Theorem (4.2) that the 
solution space of the vertex problem is given by the linear combinations of 


the partial derivatives of z4: > I (2? — 27°). The same result holds for 
the volume problem provided fx 40 (2S k <n). In view of Theorem (5.1) 
ar 720 for k& 7, By x40 for k &3. Hence, the solution space of the vertex 
problem is known explicitly for n=7 while the one of the volume problem 
is known explicitly for n 3. 
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These bounds can be improved by using slightly different congruence 
arguments but we have not been able to answer the general question. In any 
case, it follows from Sections 3 and 4 that the solution space, both for the 
vertex and volume problems, is finite dimensional. 

We now discuss the space of functions with the rotated mean value 


property (r.m.v.p.) 
(5.17) f) = f fe+ty)au(Ty) tor zeB,0<t<e 


where T stands for an arbitrary rotation and „ stands for any of the six 
measures described above. The same method as in [8] shows that (5.17) is 
equivalent to the infinite system of equations 


(5.18) P„(T9/öz)  f— 0 I<m<») 


where P„(2) = f (z-y)”da(y), T being an arbitrary rotation. In particu- 
Y 


N 
lar Pa) ( f, ysPdu(y)) Zev. 


It follows from the work of Brelot and Choquet (3) that if f(x) satisfies 


N 
. #f/bx;? = 0 
(5.19) { 2 ie 
S(T9/0z) = 0 
where S is a homogeneous polynomial of degree m>2, T is an arbitrary 
N 
rotation, and $ æ? fS, then f(x) is a harmonic polynomial of degree < m. 
1 : 
Conversely, and such harmonic polynomial satisfies (5.19). Suppose then 
that m, is the smallest integer > 2 such that P.f Pas- The solution space 
of (5.17) will consist of harmonic polynomials of degree < mo. It follows 
that if » is the vertex or volume measure of the cube or octahedron, then the 
solutions of (5.17) are the harmonic polynomials of degree <3. 
In case of the tetrahedron, we introduce an orthogonal transformation 
u= Ts such that tya—1/Vn+1(a,+: +--+ Zn). Then 0/bu == T9 /ðx 
and (5.19) is in this case equivalent to 
Of / bun = 0 
n+l 

(5.10) > 8f/duz = 0 
gal 


Sm(L0/iu)-f=0 (83SmSn+1) 


where T is an arbitrary rotation in the variables t,’ - ', un and 
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Sm(u) Oma), Onle) La 
Now Qo(a) ¢ (‘Size Se) since Qu(&ı) 740 while (6) = 0x6) —=0; here 
= i 
a= (1, 08, omt, 0, + +50). Hence Sa(u) € (tmo 2) — (tims Š u). 
Furthermore Sa(u) =S (tn, ' `ta) mod (uns Zu) where 8,’ is niot 


divisible by Siu’. Since Sy (T3/ðu) -f —0 for all n-dimensional rotations 
(Si 


in Ua, Uz’ * *, Un We conclude that f is a harmonic polynomial of degree 2. 
Conversely any such f satisfies (5.17). 


We tabulate the results of this section as follows: 








SOLUTION SPAOE TO SOLUTION SPACE TO ~ 
FIGURE m. Y. p. PROBLEM T. M. V. p. PROBLEM 
Tetrahedron (vertex) Linear combinations of Harmonic polynomials of 
partial derivatives of degree <2 = 
I  (%—2y) 
ıSi<jsnr 
g (volume) s = 
Octahedron (vertex) Linear combinations of Harmonie polynomials of 
partial derivatives of degree 3 
Dy Ly ze — T? 
1HJIGR 
(volume) “ l . 
Cube (vertex) ? “ 
l (volume) ? £ 





6. The dodecahedron and the icosahedron. We assume that the icosa- 
hedron has the following orientation. One of the vertices is at N == (0,0,1), 
the z,-axis being an axis of symmetry. The 2,2, plane bisects one of the faces 
which has N for a vertex. The vertices of the dodecahedron are the centroids 
of the faces of the icosahedron. Let @ be the icosahedral group; i.e., the 
group of orthogonal transformations which leave the icosahedron (dodeca- 
hedron) invariant. Goursat (11) has computed the following set of basic 
invariants for G. 


Qa(@) = ay? + T? + Ta 
Qe (T) = Ts? — 5 (880) Tat + 5 (880) "25? — (8° + 30°) Ta 
(6.1) Qao (T) = 23! — 35 (889) 238 + 260 (889) 24° — 175 (885) Tat 


+ 25 (850) “Za? + (8° + 50°) [12325° — 90 (880) 23° 
+15 (385) #25] + (8° + 50°). Er 
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Here, s= T; + iz, 8)<=%,—1t,. We choose {,—=(1,1,0). We will show 
that P= (Q2, Qe, Q10) for the vertex problems associated with the icosahedron 
and the dodecahedron. We treat in detail the case of the icosahedron, the 
argument for the dodecahedron being almost identical. As pointed out in 
Section 4, it suffices to show that Pe¢ (Ps), Pio £ (Ps, Ps). Let T be a simi- 
larity transformation which carries the vertices of the above mentioned 
icosahedron into the one with the vertices (£ m, +1,0), (0, +m, 1), 





(+1,0,-:m) where m= l A ([5], p. 52). Denoting the vertices of 
the original ee by y; (1=5j=12) we have 


18P (P72) =X (Ta) È (e, Tu)" 
(6.2) 
= I Spt [(1-+m°) 2. 2° +.15mt Santina? + 15m? 3 Te tpn ] 
(Here 2, == £1.) Eliminating z PERN T? -+ 2 + z and (12det? TIPAT) 
we find that l 
(6.3)  (12det? T) (P, (T>£) =R (t2) (moda? -+ s? + za) 


where the coefficients of z,* in R==15(m*— m?) £0 so that R40. Thus 
P(x) F Pe(T*z) or, equivalently, Ps(z)FP;(z). Now 


E 12 
(6.4) i 12P 0 (fs) = In" 
where y yn + Yat, (1 S710). 
X The njs are the projections of the vertices upon the z,r, plane. Two of 


these will be 0, while the others are the ten tenth roots of a positive number r. 
Thus 


(6. 5) ; . ‘ARP ro (Es) = 10r540. 


It Follow from the eier in Section 4 that P., £ (Pa Pe). The 
argument for the dodecahedron proceeds along similar lines. We just 
mention that T is to be replaced by the similarity transformation T” which 
takes the vertices y; (1720) into the vertices (+ [m-+-1],0,+1) 
(+1, + [m+1],0), (0, +1, = [m+1]), (+m, +m, =m), ([5], p. 52). 

We therefore conclude from Theorem (4.1) that for both of the above 
mentioned figures, the solution space consists of the linear combinations of 


15 

partial derivatives of [J L;(z) where L,;(z)—=0 (1575515) denote the 
jal 

fifteen reflecting planes of the icosahedral group. 
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ON THE INDEX THEOREM.* + 


By Lurr-NormMan PATTERSON. 


1. Introduction. This paper purports to present an account of the 
general index problem in Riemannian geometry from a geometric point of 
view, to point out some of the niost important index theorems, and to study 
some.continuity questions related to the index problem. The results obtained 
are: 1. AI self-adjoint boundary-value problems arising in Riemannian 
geometry can be interpreted geometrically in terms of separate endmanifolds. 
2. The subsequent extension of an index theorem? of Ambrose [2] to all 
such problems, in particular to that associated with periodic geodesics. 3. The 
continuous dependence (with some exceptions) of the Ambrose conjugate 
points on the boundary conditions and on the Riemannian metric on the 
manifold. 

We thank Professor W. Ambrose for many helpful conversations. Our 
notation will follow closely that in two papers of his [1], [2], and it will be 
assumed the reader has some familiarity with these. Attention is called to 
the fact that Bott [4] and Edwards [7] have developed a powerful approach 
to the index problem through topological methods. 

We begin by recalling some standard facts regarding product manifolds, 
which are basic for the following theory. Let M, and M, be Riemannian 
manifolds with metric tensor-fields ¢,5, and <,>2. N — M, X M, becomes a 
Riemannian manifold when we define <z, yò = <da,2, dryy>1 + (dat, dirsy)s, 
where m, and wz. are the natural projections on the factors. The map 
2 (dat, drat): TN>TM, X TM, is a diffeomorphism and these two spaces 
are indeed often identified. If X—.(X,,X,) is a differentiable curve in 
TM, X TM., that is X is a vectorfield along a curve o in N, and if X’ is the 
covariant derivative of X along c, then X’—= (X,/,X.’) where X/ is the 
covariant derivative in M; of X, along the projection o= m00 of o. ois a 
geodesic in N if and only if both its projections o, and oz are geodesics in 
M, and M: respectively. X == (X,,X,) is a Jacobifield along the geodesic o 
in N if and only if X, and X, are Jacobifields along c, and oz. Finally, 

* Received December 20, 1962. . 

1 Part of this work was supported by NSF grant G21938. 

* T. Oteuki has recently found and corrected errors in the original proof by Ambrose. 


271 


272 LEIF-NORMAN PATTERSON. gy 


suppose the geodesic o passes through m = (mı, m:) and n= (n, n2), and. 
let vo(m,n) be the order of m as a conjugate point of n along o. Then 
Vo(M, n) = vo, (Ma, M) + vo,(M2, n2). Note that if M,—M,, then the diagonal 
A of N = M, X M, is a totally geodesic submanifold of N, and hence its second 
fundamental form is 0. 


2. The index form and geometric boundary conditions. Let M be a 
complete Riemannian manifold, and B a submanifold of M X M. Q(B) is 
the space of broken O” curves in M parametrised by reduced arclength over 
the interval [0,1] and subject to the constraint B; i.e. se Q(B) implies — 
(o(0),o(1))€B. On Q(B) the usual length function L is defined by 


1 : 
Lo) f lon |==|oy|. o€0(B) is a critical point of D if and only if o 


is a geodesic in M such that its “lift” g in M X M hits B perpendicularly 
at g(0). ‘(Proposition 2.1). g is the curve in MXM defined by g(t) 
— (o(t),o(1—t)). That is, g= (o,o). Ata critical point o of L Synge’s 
formula gives information about the second variation of L in terms of a 
bilinear symmetric form I, which is a sum of two forms: an integral which 
does not depend on B, and an endpoint form which depends on 9%,,(0). 
(Proposition 2.2). SB ko) is the second fundamental form of Bin M X M 
relative to the direction g,(0), and Iz is defined on Æ X =, where = is the 
linear space of all broken ©” vectorfields X along o such that (X (0), X(1)) 
€ Boo). (These are transversal vectorfields generated by curves in Q(B) 
through o. Intuitively, Jz is the Hessian of L at o.) 


The index problem consists in determining the index of Ip (the dimen- 
sion of a maximal subspace on which Iz is negative definite) in terms of 
dimensions of certain spaces of broken Jacobifields; or, equivalently, in terms 
of a discrete set of points along the geodesic, called conjugate points, and 
certain other data which depend on the local structure of B at g(0). ‘The 
relevant local structure of B at g(0) is contained in the tangent space By o) 
and the second fundamental form 8,,(9), and from these data the notion of 

a self adjoint boundary condition is abstracted (Definition 4.51). A yector 
field X along g in M X M satisfies the boundary condition B at g(0) if and 
only if (0) € Bso) and ¥’(0) —8,,.)X(0) LBs). Here X’ denotes the 
covariant derivative of X along g. The boundary condition thus described is 
the one-endpoint condition in the manifold M X M associated: with the sub- 
manifold B and the geodesic g perpendicular to B at g(0), but it represents 
a boundary condition in M involving both endpoints of o in the following 
sense: If X is a vectorfield along o in M, then the “lift” X of X is the vector- 
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field along g in M X M defined by £=(X, X"), that is Z(H) — (X(t), X(1—4)). 
X is said to satisfy the (self adjoint) boundary condition B if and only if 
its lift X satisfies the boundary condition B at g(0) in the above sense. 

If B=8 XT where § and T are submanifolds of M, the associated index 
problem is referred to as the separated endmanifold case, and X satisfies 
B=SXT-if and only if X satisfies § at o(0) and T at c(1). If B=A 
‘(the diagonal of M) and o is periodic, then the associated index problem is 
referred to as the periodic or closed geodesic case. 

Next observe that if g is the lift of a curve o€ Q(B), then se EA, 
and all the information about o is contained in the piece of g from 0 to $. 
If o is also a critical point of L, then g hits both of the submanifolds B and A 
of MX M perpendicularly at g(0) and g(4) respectively. If G(B,A) is 
the space of curves from B to A parametrised on [0,4] by reduced arc length, 
then g (restricted to [0,4$]) is a critical point of the length function Z on 
(B,A) and Synge’s formula gives the second variation of L at g in terms 
of the bilinear form Iza (==I/sxa) on =X. Here # is the linear space of 
all broken C® vectorfields along g, starting tangent to Byo) and ending 
tangent to Api). 

The question to be answered in this section is: What is the relationship 
between Ip and Iza? Geometrically the spaces Q(B) and &(B,A) are closely 
related, there being a natural injection of the former into the latter, and 
it is therefore not surprising that the index of I» equals that of Iga. The 
importance of this result lies in the fact that all geometric boundary problems 
(B,o) in M as described above, can be lifted to equivalent problems (B X A,g) 
in M X M which are of the separate end manifold type. 

Even though B == {one point} is not strictly a submanifold of M X M, 
the theorems apply to this case also, when the tangent bundle TB is interpreted 
as consisting of the 0-element only. 

We now proceed to establish the result quoted above, and for the sake of 
completeness include 


PROPOSITION 2.1. o€ Q(B) is a critical point of L if and only if o is 
a geodesic and gy(0) L Byo), where g = (0,0). 


PROPOSITION 2.2. Let c€ Q(B) be a critical point of L. If XE#R 
(= (B),), tf a: [c, d] > Q(B) ts a broken O” curve tangent to X at o==a(c), 
and if f= Log, then 
P 2 i 1 
21) PO) = (1/8) f (ZL ZE) + (1/6) <8 (0), 2 (0). 


9 
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Here XL is the component of X perpendicular to oy, k = | ox |, and T(X,Y) 
= YX’, Y — <Rosxoy, Yy where R is the curvature tensor in M. 


Proof of Proposition 2.1. We refer to the calculations in [1] regarding 
broken C” curves in Q(B). Precisely, «:[c,d]—>Q(B) is called a broken 
C@ curve in Q(B) if the map (t,s) >«(s)(t):[0,1] X [¢,d] >M, also 
denoted by a, is continuous, and such that for a finite sequence 


0<h <b ch <l 


the mappings a | [t,, tin] X [c, 4] are O” into M. To demand that « be a 
curve in Q(B) implies furthermore that (a(0,-),a(1,-)) is a curve in B. 
Define a vectorfield along o in & by X(t) —at,(c). Then dL(X)=f’(c) 
by definition, and the formula below will show that f’ (c) depends only on X, 
not on the whole rectangle a. (a, considered as a curve in Q(B), is said to 
be tangent to X.) : 

. Under the only assumption that a+ (—o,) has constant length, which 
certainly holds because of the reduced arc length parametrisation, the following 
formula is derived in [1] via the first structure equation, for any broken 0” 
rectangle ain M. (dL(X)—= )- 


F Ce) — (1/k) <om (1), Z (1) > — (1/k) <o (0), X (0)> 
Ht (1E) (Ko (47), X (4) > — Con (tt), X (4) >) 


— (17k) Sg, E>. 


The two first terms on the right hand side can be combined to yield 
— (1/k)<g2(0),£(0)>, when we denote the metric tensor in M X M also 
by <,>. (We have used here the fact that 


Gu (t) = (o4 (E), — og (1 — t) ) = (oy, — og) (t).) 


If dL=0 at o, then f(c) =0 for all X (f depends on X). As in [1], 
by making appropriate choices for X, we conclude 1. o, is smooth, 2. 
9«(0) LBs) and 8. og = 0, which imply o is geodesic with lift g perpen- - 
dicular to B at g(0). 

Conversely, the same formula shows that if o satisfies these conditions, 
then di —0 at ø. (Proposition 2.1 represents a transversality condition in 
the calculus of variations.) 


Proof of Proposition 2.2. We assume o is a critical point of L. «œ will 
be a rectangle as in the previous proof. Under the only assumption that o 
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is a geodesic in M, the following formula is penton in [1, formula 3.8] 
via the second structure equation, . 


(= (1/k) f (ZL, ZL) + (1/k) <a (1,0), ml, 
et (1/k) <aı (0, c), aa (0, C) a>. 


Here da({a.(-,c)) =ox(-) and da(a,(-,c))—2X(-). Along the curve 
a(0,*) we have a vectorfield Zo, namely the field of tangentvectors to a(0,-). 
Similarly along «(1,-) we have Z,. In particular, since («(0,-),«(1,-)) 
lies in B, Z= (Z,2,) is tangent to B. Since <a,(0,c),a2(0,c)a2> 
= (04(0),20(0)2,>, where Z,(0)Z, is the covariant derivative of Z, in the 
direction Z,(0), and since covariant differentiation in a product manifold 
corresponds to covariant differentiation “in each of the factors,” we obtain 


1 
Po) = (1/6) f P(X, XL) — (1/b) (0) Z,94(0)>- But if gu(0) is a 
vector perpendicular to B and Z(0)Z the covariant derivative in M X M of 
Z in a direction tangential to B, then by a standard fact for second funda- 
mental forms <g4(0),Z(0)Z> == <— 8Ps) Z (0), Z(0)>. And observing that 
Z(0) = (Za (0), Z1 (0)) = (Z (0), X(1)) =# (0) we get 


P(e) = (1/k) f T(E XL) + (1/8) <88a 102 (0), 2 (0)>, 


which is the desired result. 


PROPOSITION 2.3. [7,2] Every real self adjoint boundary condition at 
g(0) = (o(0),o(1)) [for which o is critical], arises from a submanifold B 
of MXM [intersecting g perpendicularly at g(0)]. 


Note. If o:[0,1]— M is a closed, but not smoothly closed (periodic) 
geodesic, then o is not a critical point of L in O(A), because gẹ(0) is not 
perpendicular to Agia). 

In the rest of this section we shall adopt the following notation. B will 
denote a fixed submanifold in M X M, o a geodesic in M with lift g = (c,07) 
perpendicular to B at g(0). g will be regarded restricted to [0,4]. Note 
that g4(4) is perpendicular to Asa). We consider these linear spaces (over 
the reals) : 


E(=D(B,A),) = {%|% is a broken C” vectorfield along g 
(on [0,4]) and 96(0) € Bao, (4) € Aga} 
Bl {%¢E{%195} 
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Be (GE Z| Gz}, Z= 214 2° (direct sum). 
== {X|X is a broken C” vectorfield along o and 
(X(0),X(1)) a 
ZL = {ZXE2|X Log}. 


Corresponding to Synge’s formula of Proposition 2.2 we define two index 
forms Ip and Isa on EX Z and EX & respectively by 


(21) DRM) f EL FL) + (1/8) Spm (0), P (0)> 


(2.2) Ina(96, Y) — (kV 2) f Ts, YL) + (EV) zn W0), Y (0)> 
— <tn B), Y (4)>) 
= (EVD f RL, Y + VDE BO), KO) 


where X,Y EH, k= | o4], | ge] kV 8 and %,Yc8. r, D are as in 
Proposition 2. 2. 


Lemma 2.4. a) The lift i: Ho: X>X is an isomorphism. b) If 
U =r (BL) (and V =i (8°)), then BL CU. 


Proof. a) X€ = implies LEE, since X(0) € Bpo) by the definition of 
= and since &($) = (X($),X(4)) € Agi). (Ë is restricted to [0, $].) 


i is linear; for (aX + Y)= (aX + Y, (aX + Y)-)=(aX¥ + Y, aX- +Y) 
== a(X,X-) + (XY, Y) = ai(X)+ iY). 7 is injective; for (X) =0 implies 
(X,X-) = 0 on [0,4]. Hence X =0 and X-=«0 on [0,4], or Z=0 on 
[0,1]. zis surjective; for X = (X, Y-) € & implies X and Y are vectorfields 
along parts of o, defined on the intervals [0,4] and [4,1] respectively. Since 
(4) € Apu they can be pieced together to a broken C” vectorfield Z along o, 
and it is trivial that 1(Z)—%. b) If X¢€ #1, then <X,0oy>==0. Hence 
<Ë, Ja> = <X, o> — (X-, 04> = 0. Thus i(X)—Xe El, proving XE UV. 


Remark. U is strictly bigger than Ei. It contains also all vectorfields 
along o of the form yoy, where y is a broken C” function satisfying (1) 
y = y and (2) y (0) (o4 (0), ca(1)) € Byte). (In case B =A and ø is periodic, 
(2) represents no additional restriction. In case B=S XT, (2) implies 
¥(0) = 0.) V consists of all vectorfields X along o such that X — doy, where 
g==—g and o(0) =O0—¢(1). For X¢ V if and only if ¥ = Bg, where 
B(0) =8(4) =0. But £ == (X,X-) and gẹ = (o4, — oy). Hence X = fon 
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and X—— Boy on [0,4], or X=— Bo, on [4,1]. Put (t) A(t) if 
1E [0,4], =—— p (t) if te [4,1]. Then ¢——g and 0 = $ (0) =—¢(1). 

Leusa 2.5. a)OnUXU V2* (Isa) = In + I, where I is the positive 
1 
semi-definite form on = XH defined by I(X, Y) = (1/k) f, «X, ¥ and 
X° is the component of X tangential to c+. 


b) The subspace V of & is totally singular relative to both i* (Isa) 
and Ip. 


Note. X” =X’, and so I(X, X) —0 if and only if X” —0 if and only 
if X° = Aog, A constant, 


Proof of a). spins X, Ye U. Then 


sad = "h 2 a 
kV (Ina) (X, Y) =k VIs (2, Ë) = Í, (KE, E’ — <Bptge, 72) 


+ End term 

-f (<E, Y’ +< X, — Y’ — Roxo Y> — <B-ov-x-— og, 7°) 
+ End term 

= ae (2,2% — Beare Y>) — =Í (I, 7 — Booe Y>) 
+ End term 


om f (<X’, Y’ — CRaxos, Y9) + End term 


= Í "(a Fly eR TE A f ” X", Pry 4 End term 
= kIn(X, Y) +kI (X,Y). 


Proof of b). Ti X€ V, Y € Z, then 0 = Ipa(X, Y) = i*(Ipa(X, Y) because 
£¢ = and 2° is a totally singular subspace of & relative to Ina. On the 
other hand we showed previously that X € V implies X == ġo, where ¢ == — p” 
and ¢(0) =0—4¢(1). Hence f 


“1 
Tn(X,¥) = (1/6) | TIL FL) + (1/8) 8% Z (0), F(0)>—0 
This proves b). 
Lemma 2.5 shows that for a comparison of Is and Iza (via i*) we can 
restrict attention to the space U. Define P == \V/2i*(Isa)|U XU. Because 


4 is an isomorphism of U with EL, the index and augmented index of P equal 
those of Ina | BLX EL. While &1 is the “right” space for the boundary 
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a 


problem (B X A,g) in the sense that the index and nullity of Isa | E- X Z4 ` 
give the relevant geometric information regarding shorter paths in Q(B; A) 
near g, U (or &) is. not. “right” for the problem (B,o) because the nullity 

n(Is |U XU) is not Kane ‘The appropriate space to consider is W, defined 


below. 
W = {X € U | X = XL + avy, where a is a constant} 


(2.3) = {X € U | X” =0} 
U? = {XEU | X || oy and Z (0) =0 = X (1)} 
(Recall that U = 1+ (8L).) 
Remark. If B=8 XT, then W = {X |(X(0),X(1)) € Saco) x Ton 
and X == XL}. If B=A and o is periodic, then W includes the subspace {ox}, 


and equals 21+ {o,} where =! is the space of all broken C@ closed vector- 
fields Loy. In fact, this sum is orthogonal with respect to the form Is and 


Ia restricted to {ox} X {cx} is 0. 
Lemma 2.6. U =U" p W, where ® means ie ect orthogonal sum with 
respect to P. Moreover, 
P | Ue X U°=1|U°x UW? and P| WXW=I| WXXW.. 


Proof. We first show that this sum is direct. If XEU, then 
X= XL 4 po, where ọ=k?<X, o>, and <, ga =0. But <Ë, 94> 
= X, og) — KX, 0p) = $0502) — <b 0K, 02> (BE) k. Hence 
9-4. X=(ZL+o(0)os) +(¢—4(0))oe, and since ¢(0)=¢(1), 
Y — (6—¢(0))oy is 0 at O and 1. So ¥(0) =0€ Bso. Further 


<¥, In) = <(¢—$(0)oz, ox» —<(¢— (0) Yon ox > 
= (#—$(0) )k — (¢ — p (0) ) = 0. 


Thus Ye U”. It follows that XL+ 4¢(0)o,—X—YeU and hence in W. 
Because U?’ N W — {0}, we have proved that U = V° + W. 
Next, suppose X € U°, Ye W. 


P(Z, Y) ~In(X,¥) +I (X,Y) = (1/k) fras YL) 
+ (I/F) <S (0), P(0)> + (1/8) fk", E> 0, 


because XL = 0, £ (0) =0 and Y” —0. The same formula shows the last 
part of Lemma 2.6, if we let both X, Y € U° or both X,Y € W. 


Leama 2.7. i(P) —i(Ip| WX W) —i(In), n(P) =n (Ip Iwxw). 
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Here i(P) = index of P, n(P) = nullity of P. (At this stage tt has nol 
been shown that any of these numbers are finite.) ; 


Proof. i(Is) =t(Is|U XW) is a consequence of Lemma 2.5b). In 
the rest of this proof Ip will be understood to mean Ip|U XU. Thus 
P= Ig + I, where I is positive semi-definite. In fact, I | U° x U? is positive 
definite. (For we have shown before that I(X,X)=0 if and only if 
X° Aoy. If also Ze U’, then X =X" and A==0.) Because P = Ig + 1I 
and I is positive semi-definite, 4(P) Si(Iz). Now suppose Is <0 on N 
(meaning Ip | N X N is negative definite), where N is a subspace of U. Let 
Nw=rr(N), where xr is the P-orthogonal projection of U on W. 
ker(mw | N) C 0°. Hence, if X € ker(my | N), then X € U’ and Is(£, X) =0, 
contradicting the fact that Is <0 on N, unless X=0. Hence Nw is iso- 
morphic to N and Ip <0 on Nw since Is (X, X) =Is(rwX,rwX). Thus, 
if N is a maximal subspace of U on which Ig < 0, there always exists a sub- 
space Nw of W, isomorphic with N, on which Ip <0. Since P | NwX Nw 
= Is | Nw X Nw, it follows that i(P) =i(Is). Combined with the above 
inequality this yields the first part of Lemma 2.7. 

Let K be a maximal totally singular subspace of U relative to P. Then 
ECW. Forif XE K, X =Xp-+ Xw and P(X, Y) =0 for al Ye VU. In 
particular, O— P(X, Xp) =P (Xv, Xr) =I (Xv, Xv). Hence Xy=0, 
showing that XY =Xwv€ W, ie KCW. Since P| WXW=Is| WXXW, 
we obtain n(P) =—=n(Is | W X W), which concludes the proof of Lemma 2. 7. 


Summarising, we have proved 


THEOREM 2.1. Let Ip and Iga be the index forms defined on BX E 
and BX Z by (2.1) and (2.2) respectively, and let W be the subspace of = 
consisting of all broken C® vectorfields X along o, satisfying X’ —=0 and 
(X(0),X(1)) € Brewo),a(1)), where X? is the component of X parallel to og. 
Then the following relations hold between their indices and nullities 


i(Isa) =1(Ip | W X W) —i(I5) 
n(Ipa | El X BL) =n(Iz | WX W). 


As a corollary of this theorem we shall obtain a symmetric version of 
the Ambrose index theorem [2], as well as a generalization of it. With B, A. 
and g as above, the Ambrose index theorem states that the index of Isa on 
2L X 21 is the sum of the orders of the conjugate points of the ordered pair 
(A,B) on g plus a convexity term cas. The latter measures the “relative 
convexity” of A and a nearby B(t) where B(t) is the manifold B (locally) 
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“pushed over” toward A along g via Jacobifields (see also Section 4) ; pre- 
cisely cas = index of Igna when tis sufficiently close to 4. But by Theorem 
2.1 applied to the interval [t1 —t] +(Zsq)a) =#(Iaıy) where Is) is the 
index form for the problem (B(t),o |[,1—t]). We write cp for. can. 


Definition. t is a symmetric conjugate point for B on c, if g(t) 
= (o(t),o(1—t£)) is a conjugate. point of the ordered pair (A,B) in the 
sense of Ambrose [2]. 


Thus in particular ¢<4. Explicitly, ¢ is a symmetric conjugate point 
for B on o if there exist Jacobifields X, Y and Z along o, not all equal, such 
that if %—(Y,¥-) then Se HL, (0) — Bt (0), X(t) =Z(t), 
Y(1—t) —Z(1—+), and l 


(Z) —2'(t), — Y (1—t) +2 (1—t)) 1 Bi (t) 


where B, (t) = { (u,v) € (M X M)sa) | u= U (t), v= Y(t) for Jacobifields 
U, V along o satisfying (U(0),V(1))€ Bio) and (U’(0),—V’(1)) 
= 93 ao) (U (0), V(1))}. 


Theorem 2.1 in conjunction with the Ambrose theorem yields 


_ THEOREM 2.2. Let B be a submanifold of M X M, o a geodesic in M 
defined on the interval [0,1] such that the geodesic g= (o,o) hits B 

perpendicularly at g(0), and let W be the linear space of all broken C@ - 
vectorfields X along o such that X” —0 and (X(0),X(1)) € Bpo), where 
X° ts the component of X parallel to oy. If i(B) is the index of Is| WXXW, 

where Ig ts defined on ZX E by (2.1), then 


i(In) =1(B) = Ent) +s <% 


where n(t,B) ts the order of t as a symmetric conjugate point for B on o 
and cp ts the convexity term referred to above. 


Remarks. 1. If B—S XT this theorem gives a symmetric version of 
the Ambrose theorem, in which both submanifolds § and T are pushed toward 
each other at the same speed. In particular, csxp is the index of Isara- 
when ¢ is sufficiently near 4. We describe a special case of some interest. 
Let $ be arbitrary, but T only the point ¢(1). Then ¢ is a symmetric con- 
jugate point of SX T if 1— t is a focal point of the boundary condition 8 (t), 
that is if there exist Jacobifields X, Y along c, not both trivial, such that 
X(0) € Soo), X (0) = Run (X(0)), X(t) = Ft), Y(1—t)=—0 and 
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X’(t) —Y’(t) LS,(t). If we assume known that the focal points of a sub- 
manifold along a given geodesic perpendicular to it cannot occur arbitrarily 
close to the submanifold (see Section 3), and if we furthermore assume that 
4 is not a strong focal point of 9 (see [2], or Section 4), then the continuous 
dependence of S(t) on ¢ near 4 implies (by the continuity theorems of Section 
4) that csxr==0. If 8 also reduces to a point, so that S X T is just the 
point («(0),0(1)), the symmetric conjugate points are just symmetric pairs 
of conjugate points in the usual sense, i.e. pairs (t,1—-t) for which there 
exist non-trivial Jacobifields vanishing both at ¢ and at 1— t. In this case 
Csxr = 0, trivially. We summarise this remark in a 


COROLLARY. If B=S xX {o(1)}, and tf 4 is not a strong focal point 
of S, then i(B) = $, n(t,B). 
OES 
(Note that in the simple case when S = {v(0)} this corollary is a consequence 
of the continuity Theorem 4.3 of Morse.) 


2. If B= A and o is periodic, a new descriplion of the index of closed 
geodesics results. 


3. In order to obtain Theorem 2.2 we pushed the manifold B toward A. 
Another theorem would result if we pushed A toward B (though in the periodic 
case when B = A, these two theorems would be no different). 


3. Index theorems of Morse. This section is devoted to a proof of 
the general index theorem (3.2) as it was apparently first indicated by Morse 
[13]. This important index theorem does not seem to be widely known, 
perhaps because Morse’s results are phrased (in great generality) in the 
language of the classical calculus of variations. Another proof of it is given 
by Edwards [7]. This index theorem of Morse does not seem to imply a 
recent one of Ambrose [2], nor conversely. 


The geometric setting is as in Section 2. We consider the space W of 
all broken C” vectorfields X along the geodesic o on the interval [0,1] such 
that (X(0),X(1)) € Beoc,ocy) and X” —0, where X° is the component of 
X parallel to oy. We assume the problem is critical (i.e. the lift g of o is 
perpendicular to B at g(0)). The index form Ig is defined as in (2.1) on 
WX W. We seek to determine the index and nullity of Is in terms of the 
conjugate points of «(0) along o and the index and nullity of Ip restricted to a 
finite dimensional space of Jacobifields along v. 

We shall make use of the well-known focal point theorem, and state it 
explicitly. Proofs can be found in [2], [9], [12], [14]. 
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THEOREM 3.1. Let W be the space of all broken O” vectorfields along 
and. perpendicular to the geodesic o, tangent to the submanifold S of. M, 
(which is assumed to hit o perpendicularly at o(0)) and vanishing at o(1). 
Let Iss (= Isxocı)) be the index form of the second variation for this problem, 
restricted to W X W, and fs(t) the order of a(t) as a focal point of 8 eken o. 
Then 

index of Iso =i(Isn) = $ fa(t) <œ 
otc 


nullity of Igo = te (Igo) = fg(1). 


For the proof of Theorem 3.2 only the special case of Theorem 3.1 where 
S is the point o(0), is needed. But the same methods that lead to Theorem 
3.2 can be used to obtain the index of Ig in terms of the focal points of B 
along g and the index of Ig restricted to a finite dimensional space of Jacobi- 
fields along o with breaks at one point, and for this Theorem 3.1 in full 
strength is needed. 

We now develop the algebra needed to prove Theorems 3.2 and 3.3. 
In the most usual (“non-degenerate”) case, when o(0) is not conjugate 
to e(1), the proof of Theorem 8.2 is so exceedingly simple that we believe 
a separate proof for this case is justified. Lemma 3.1 below deals with the 
complications that arise in the degenerate case (which are often algebraic rather 
than geometric in nature). Since this lemma does not seem to generalise to 
the cases where V and W are not finite dimensional, it is necessary to reduce 
the problem geometrically to a finite dimensional case, to which Lemma 3. 1 
applies. . 

Notation. Infinite (©) means “not finite,” and <œ% means “finite.” 
V is a vectorspace over the reals, 6(V) dimension of V. f: VXV>R 
is a bilinear symmetric form, p =f | W X W is the restriction of f to W x W. 
f <0 on a subspace T means f | T X T is negative definite. 


Wie= {ce V | f(z, y) =0 for all y€ W}, 
S= {ce V | f(z, y) = 0 for all yE V}. 
q=f| WLX WL. v(f,p)=8(W N8) and i(f)(a(f),n(f)) is the index 
(augmented index, nullity) of f. 
Lemma 3.1. Assume 8(V) <0. Then s(f) =a(p) -Hilg) —v(f,p) 
—i(p) +n(p) +4(q) —v(f, p). 


Proof. WS; is a subspace of Sp Let U be any Knie of % 
in W while U is any compliment of WM 9; in 8p. Then 
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W =U D UO (WNS;) =U O Sp 


where @ means orthogonal sum relative to f (or any form induced by f in 
appropriate subspaces.) Thus i(p)=i(p| UXU). Notice that WiN W 
am S,C Sq, and that WL—=T Ss =T OT OSI, where T is any compli- 
ment of S, in Wi. Put k=ð(U). P is called an f-hyperbolic plane if 
(P) =? and if i(f | P X P) 1. 


; Lemma 3.1A. There esist f-hyperbolic planes Pı: Pr such that 


Proof. We refer to Theorem 3.8 of Artin [3]. The algebra involved 
is standard and forms the main step in the proof of Witt’s theorem. 

From Lemma 3.1A we now deduce Lemma 3.1 in the following manner. 
i(f| UXU) =i(p| UXU) =i(p), if] TXT) =i(q| TXT) ig), 
and i(f|P:XP:)—=1. By Lemma 3.1A i(f)—=i(p) +k+i(g) —i(p) 
tkt p) —v(f, p) +4(9) = alp) —v(7, p) +4), which proves Lemma 
8.1. 


Lemma 3.2. Suppose V == W ® U, whered(U) <% (but V and W may 
not be finite dimensional) and ® denotes orthogonal direct sum with respect 
to f. Suppose i(p) <%, and let gam f | UXU. Then i(f) =i(p) +4(q). 


Proof. if) = i(p)+i(q) is obvious. Before showing the opposite 
inequality, we eliminate the possibility that i(f) =». For if (f) =», there 
exist subspaces D,, of V of arbitrarily large dimension m on which f <0. 
Then D,, is contained in the finite dimensional subspace K„—= aw Dn BU of 
V, where ww denotes the orthogonal projection on W. Since the lemma is 
true for finite dimensional spaces (then a special case of Lemma 3.1), 
we obtain i(p) +4(q) Zip | rvDn X twDn) Hg) = if | En X Em) m. 
Since t(p) and t(q) are fixed (independent of m) and finite, this would lead 
to a contradiction if m is unbounded. 

Thus, letting D be a maximal finite dimensional space on which f < 0, 
the same reasoning as above shows i(p) Hi(g) Zi(f | K XK) =i(f), com- 
pleting the proof of Lemma 3.2. 

We can now turn to the proof of the general index theorem of Morse. 
Let Jz, == {X € W | X is unbroken Jacobifield along o}, and Jr =—= {X € Jg, | X 
satisfies the boundary condition B}. Finally, put W°— {Ye W | X(0) —0 
= X (1) }, IP == Ig | We X W and Eg — Ip | JB, X Jn. From the integration 
by parts formula ` 
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(3.1) MR N [Bas 2", Fy + ECF tr) Li), 7) 
4 <-2'(0) + 82.0 (£(0)), P(0)> 


applied to X, VE W (we have used the property that X” —0 to obtain this 
formula) we conclude that Eg(X, Y) = (1/k)<— £’(0) + 84. (0)(£(0)), Y(0)> 
if X,Y € Jp. 

Let n(t) denote the order of o(#) as a conjugate point of o(0) along o 
(in the ordinary sense). i(/z) is the index of Is on W X W and i(FEp) the 
index of Eg on Jz, X JB, 


THEOREM 3.2. (Morse) 
a) i(Zn) = I n(t) +i(Ba) —v(B) <% 
0<tsı 


b) n(Ip) = dimension J3*. 


Here v(B) = @(J3* N J°) — dimension of the linear space of all Jacobifields 
in W satisfying B and vanishing at o(0) and o(1). 


Note. v(B) =0 if o(0) is not conjugate to o(1) along o; (the non- 
degenerate case). 


I. Proof of Theorem 3.2 in the non-degenerate case. We claim 
W = W° O Jpg, where & denotes the orthogonal direct sum with respect to 
the index form Ip. If our claim is correct, Theorem 3.28) is immediate by 
Lemma 3.2 and Theorem 3.1. 

We prove the claim by observing that if X € IV, there is a unique Jacobi- 
field Y € W such that ¥(0) (0), because o(0) is not conjugate to o(1) 
and Ye W implies X’%=—=0. Thus Y==(X—YV)+Y uniquely, where 
A—J EW and Y€Jz,. It remains to show this sum is orthogonal with 
respect to Ig. Let Ye W°, XEJpg. Then (3.1) shows that Ip(X, Y) = 0. 
Hence our claim has been proved. Theorem 3.2b) is proved as below. 


II. Proof of Theorem 3.2. Part b). Suppose Ip(¥,¥) —0 for all 
YeW. In the usual way by making appropriate choices for F, it follows 
from (3.1) that X is smooth, that X is Jacobi and that X satisfies B. Hence 
the nullspace of Ig is contained in J»*, and the converse is trivial by (3.1). 
Part a). As in Section 2 we “lift” the problem to MX M. Choose a normal 
sequence {t} for [0,4] on g = (0,07) ([2], page 64, or Section 4.). Let B 
be the corresponding space of broken Jacobifields perpendicular to g with 
breaks at the t, starting tangent to B and ending tangent to A. W, by 
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definition, is isomorphic to W via 4, in fact conformally relative to the forms 
Isa and Ip. There is a projection map 8: #18, and as in Theorem 1 of 
[2], we obtain that i(Ina| WX W) =ils | WN BX WB). Defining 
B =r (Ù N B), we consequently obtain that i(Is) =i(1 | 8x 8). B is 
described explicitly as the space of all broken Jacobifields Y along o with 
breaks at the 4; and 1-— t, such that X° = Ao, where A is constant, and such 
that 4 (0) € Bgco). 

We apply Lemma 3.1 to B, with W == W° N B and f—Is|8x 8, 
and claim (1) i(f) —i(In), (2) a(p) —a{l | We x W°), (3) ilq) —i(En), 
(4) v(f,p)=v(B). Interpreting the right side of (2) in the light of 
Theorem 8.1 in the “fixed ends” case, i.e. S—{o(0)}, we obtain Theorem 
3.28). 

It remains to verify (2)-(4). Proof of (2). Since {t,1—t} is a 
normal sequence for [0,1] on o, (2) is a consequence of the reduction 
described in Theorem 1 of [2], as applied to the fixed ends problem. Proof 
of (3). We must show that the perpendicular space to W° N B relative to Iz 
in 8 is Jg. So suppose Ze (WM B)L. Since X is broken Jacobi in W, 
formula (3.1) gives that 


0—kIn(X, Y) = IX’ (sr) — X’), P(s)> + bEs(X, F) 
=X (sy) — X (st), ¥(s)> for al YE WN B. 


(As usual the summation is over the breaks of X.) From appropriate choices 
of Y, namely such that Y(s,)=0 except when j=r, we deduce that 
X’ (s) —X’(s,*) is tangential to o,(s-). But the tangential component of 
X’ is 0, hence X has no break at s, Thus X€ Jz, and (WNB)LC JR. 
The converse is immediate by (3.1). Proof of (4). Observe the definition 
of v(f, p) and use b) above. 

We next prove the analog of Theorem 3.2 with focal points of B rather 
than conjugate point of o(0). 


THEOREM 3.3. (Morse) 
i(Is)= È fa(t) +t(Fs) —v(B, 4) <. 
x 
Here fn(t) = order of g(t) as a focal point of B along g=(o,0”), 
Fg = [Ig | J(B,4) X J(B,4), J(B,4) = {XE W | X satisfies B and is broken 


Jacobi with at most one break at o(4)}, and v(B,4) =6{XE W | X is smooth 
Jacobi satisfying Band X(4) = 0}. 


COROLLARY. If B=SXT, then 
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i(Isr)= I fs(t)+ E fr(t)+t(Psr) —v(8T, $) <% 
oct << 


. Remark. This corollary appears in a slightly greater generality in Morse 
[13], the division of o occurring at an arbitrary point, not necessarily the 
midpoint. The method of proof is precisely the same, except that in ‘this 
case of separate end manifolds there is no need to consider the problem 
in MX M. : 

If Theorem 3.3 is applied to the case when B=A and o is periodic, no 
new statement results; we only obtain a restatement of Theorem 3.2 for B= A. 


Proof of Theorem 3.3. We use the same notation as above. In addition 
Bl (B,0) = {| % is broken C* along and perpendicular to g, starting 
tangent to B and ending with 9%(4) ==0}. Js, is the index form for the 
problem (B X {g(4)},9) in MXM. Recall that W—=7(W). Then the aug- 
mented index a(Izo) = a (Izo | BL(B,0)N WX EL(B,0) NW). Next choose 
a normal sequence for [0,4] on g, and let 8 be the associated space of 
broken Jacobifields, starting tangent to B and ending tangent to A. Denote 
=1(B,0) WB by F. Then, as in the previous proof, we obtain 


i(Isa | BOW X BOW) ill) =i(Is), alls |F X F) = aIr). 


Hence, by Lemma 3.1, i(Is) =a(Iza | FX F) +i | FLY FL) —>. 
This implies Theorem 3.3 when we notice that Iga | Fx F — In, | 5x § 
and apply Theorem 3.1 to express the index of Ig, in terms of the focal points 
of B along g; when we observe that y==»(B,4) ; and when we prove that the 
orthogonal space to Fin W N B relative to Iga is precisely J(B, 4). The latter 
is seen in the usual manner from the integration by parts formula for Ipa. 


Remark 1. In the case of separate end manifolds, B = 8 X T, Morse 
states a slight generalization of Theorem 3.2 which is named “generalized 
concavity theorem.” It says. 0b, <b, <`: > <bp < bpa —1, if y= the 
number of conjugate points of b; (along o) in (bj, ba] counted with multi- 


? 
plicities, then i(Isr) = X ki +i(Isr | Jp X Jp) — m where Jp == {X |X is a 
i=0 
broken Jacobifield along o with breaks at the b, everywhere perpendicular to 
o, and starting tangent to S, ending tangent to T}. vp» 0{X | X is unbroken 
Jacobi, satisfies 9 and T and vanishes at all the b, i— 0,1, -,p+1}. 


The proof is carried through in the same manner as in the case of 
Theorem 3.2. Let W,°=={X|2X is broken C= along o and X(b,) —0, 
t= 0,1,---,p-+1}. When Lemma 3.1 is applied to W,° (or more precisely 
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to. a suitable finite dimensional subspace of broken Jacobifields), and when 
we observe that W,°1 relative to Isr is Jp the statement above follows. 


2. A more general theorem of this sort can actually be obtained by the 
same simple methods. It relates the indices of Isr, Igy and Irr for any three 
submanifolds S, T and U of M perpendicular to the geodesic o at o(0), 
o{r) and o(1), respectively. 


4, Continuity properties of the index form. 


4.1. Given B= ((,3,8,T,o) where <,> is a (complete) Riemannian 
metric on the manifold M, S and T are submanifolds, and o is a geodesic 
starting and ending perpendicularly on S and T respectively. Intuitively, we 
ask: If i(B), the index of the second variation problem associated with the 
data B, is considered as a function of B, is i(B) stable (under sufficiently small 
variations in B)? Do the (Ambrose) conjugate points depend continuously 
on B? It is perhaps no surprise that the answers are affirmative, provided 
the nullity of the problem B is 0 (Theorems 4.1 and 4.2). But there are 
two possible topologies on the set of self adjoint boundary conditions, one 
which corresponds closely to the geometric description of boundary conditions 
(Section 2), and another (coarser) which is natural when the boundary con- 
ditions are regarded as elements of a Grassmann manifold (4.5, Definition IT). 
We shall show also, that if we use the latter topology, the answers to the 
above questions would in general be no. 

The continuity theorems will be formulated analytically due to their 
generality. The transition from a geometric problem (<¢,>,8,7,0) to a 
problem in Rd (d+ 1 = dimension of M) is effected by a choice of a parallel- 
translated frame along o, the first d vectors of which span the tangent spaces 
perpendicular to o,. Where a change of end-manifolds and Riemannian struc- 
ture is involved, many such choices will have to be made so as to give con- 
tinuous or differentiable maps to which the theorems below apply. We remark 
that these theorems are stated only for separated end conditions, but we proved 
in Section 2 that the “more general” ones are included as special cases. 

4.2. Notation. R4 is d-dimensional Euclidean space with the natural 
inner product <,>. K: TRi— Rê is the usual identification map. Broken 
C° curves in R¢ are sometimes referred to as broken O” vectorfields. If X 
is such a curve, put X’ == KX, wherever X, is defined. #(s,¢) is the linear 
space of all broken C® curves defined on [s,1]. 2°(s,t) = {X € Z (s, t) | X(s) 
=Q—=X(t)}. M(n,d) is the manifold of linear transformations from R” 
to R? (the additive group of dX n matrices). G@L(d) is the general linear 
group of automorphisms of R. §(d) is the manifold of self-adjoint (sym- 
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metric) linear transformations of R® relative to <,>. A family of curva-. 
ture transformations depending on a parameter «€ Rt ig given. Precisely, 
R: RFX R'—>8(d) is a continuous map, such that in addition the maps 
R*—R(a,-): R>S(d) are O” for each ge R* (We write R! for the 
reals in order to avoid confusion with the curvature map R). Tas) is a 
bilinear symmetric form defined on E(s,8) X E(s,t) by 


t 
(41) | Iam(ZY)=f(a) f (KEY — RX, Y>) 
where f: R*>> F is continuous and strictly positive. 


4.3. Jacobifields, associated maps and ordinary conjugate points. Asso- 
ciated with each a is the Jacobi equation 


(4.2) X” + RX -0. 
J= ig the 2d dimensional solution space of “ a-Jacobifields.” 
J%(8) = {X € J" | X(s) — 0}. 


For each (a,s,t) define %,: R22> R% by ty (a, 2’) = (X(t), X’(t)) where 
X is the unique «a-Jacobifield such that (X(s),X’(s)) =(a,2’). Define 
“evaluation” maps E*%,, F": R?¢—> Rd and Fe, Ff’: RE Ri by 
Hy (a0) =X (t), Bulea) =X (t), Faly) =F (t), Puly) = Y(t) 
where X is as above, and Y is me un a-Jacobifield such that (Y (s), Y’(s)) 
= (0,4). 

A skew symmetric bilinear BERN form J is defined on R*4 x R?4 
by J: RE x R* Rt: ((2,y), (uv)) > <T, v> — <y, uy when z, y, u, v€ R3. 
The set of element of GL(2d) which preserve J form a Lie subgroup H. 
The following are now consequences of the: general ‘theory of differential 
equations [8]. 


(I) SuEH, and: ReX BX BA: (4,3, t) Sige. is contintious 
(in fact differentiable for each fixed a) and satisfies ee Pta. (I) 
implies 
7 E, E: BEX RX R>M(2d,d): (a, 8, t) > Ep By 
PP: BX BX BW (d, d) : (a, 8, t) > Fr, Fy 
are continous: and differentiable for each fixed a. | 


(IT) 


As usual we dee (s, t) to be an a-conjugate pair tee 8. a Aa ‘to ty 
if there is a nontrivial X € J* guch that X (s) — 0 = X (t): The order of (s, t) 
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is the dimension of the subspace of J* spanned by such X. In particular (s, s) 
has order d for any a. 


Lemma 4.1. Let O and D be any compact subsets of R* and R* respec- . 
tively. Then there exists a positive number 8 (depending on C and D in 
general) such that if s€ C0, 0< [s—t] <8, then (s,t) cannot be an a- 
conjugate pair for any a€ D. 


Remarks. 1. For a fixed a this lemma corresponds to the fact that if 
C is a compact subset of a complete Riemannian manifold M, there exists 
è> 0 such that exp,, is a diffeomorphism on every ball at the origin of Mm 
of radius less than 8, for any me C. The parameter a may be regarded as | 
representing a particular Riemannian metric on M (although R* will not 
in general be the curvature tensor associated with some metric on M). 


2. The method of studying the solutions of the differential equation 
(4.2) via the form (4.1) is classical and applicable to a much larger class 
of differential equations. , 


Proof of Lemma 4.1. (a) Given C,D as above. Then there exists 8 > 0 
such that Ia) is positive definite on J“(s) for all (8,a)€CXD and 
0 <|s—t| <8. From (a) the lemma follows when we observe that if X € J“ 
and X (8) == 0 == X(t), then Ia (X,X)=0. The claim (a) is a conse- 
quence of the continuity of the functions F and F” together with the facts 
that F%,,—0 and Fas = Ia (the identity map) for all (a,s). 


4.4. Normal sequences. Following [2] we define an a-normal sequence 
{4} for [s, t] to be a finite sequence such that s<t,<---<t,<t and 
such that there are no «-conjugate points of t; in [ti tm] except t; itself 
(t=m1,---+,p), and no a-conjugate points of s in (s,t,] and of t in [tp t). 
(The last assumption is actually redundant by the index theorem for fixed ` 
endpoints). l 


Lemma 4.2. Given (a,8,¢) € REX RX Rt, s < t, and a compact neigh- 
borhood Da of a. Then there exist an a-normal sequence {4} for [s,t] and 
neighborhoods U, and U; of sand t so that for every (à, 3, f) € DaXU, XU; 
{ti} is an -normal sequence for [3, F]. 


yi 


Proof. Let C be any compact neighborhood of [s, t]. By Lemma 4.1 
there is ô > 0 such that ce C and 0 < |c—d| <8 implies c is not &-conjugate 
to d for all &€ Da. Choose any sequence {4} such thats<t,<---<tp<t 
and 8/8 <|&—tiil<8/2 (t—1,---,pt1to—8, tpt). Let U, 


` 10 
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— {cl |c—s| <8/3} N 0, U= {c | |c—t| <8/3} N 0. With these choices 
for {t}, U, and U, Lemma 4. 2 holds. 


4.5. Self adjoint boundary conditions. We proved (Section 2) that the 
aspects of a submanifold and a geodesic perpendicular to it relevant to any 
index problem, are its tangent space at the starting point of the geodesic and’ 
its second fundamental form relative to the starting direction of the geodesic. 
These data are abstracted in 


Definition I. [7] A self adjoint boundary condition in dimension d -+ 1 
is an ordered pair of endomorphisms of R4, (8,8), satisfying 


(B1) 8, is an orthogonal projection, (B2) Sz is self adjoint, 
(B3) 8(Ia— S81) = l; — &. 


It follows that 9:9: —= S9.. (The dimension d+ 1 refers to the dimension 
of the space in which the submanifold is imbedded and not to the dimension 
of the tangent space of the submanifold. The dimension of the latter is the 
dimension of the image of S;.) = ð (d) is the subset of S(d) X 8(4) 
consisting of all self adjoint boundary conditions in dimension d -+ 1, given 
the induced topology. As in [2] we also denote the image of the projection 
8, by Si. Suppose (9,) =k. Associated with (8,,8,) is a k:plane p in 
4, which we call the essence of (8,, 8), defined by p = {(812, 9.8.2) | z € R*} 
— {(y, Say) | yE K}. 

Let J: R*4—> R* be the bilinear skew symmetric form defined in 4.3. 
A maximal subspace P of RB such that J | PX P=0 is called a maximal 
nullspace of J and has dimension d. 


Definition II. [Y] A self adjoint boundary condition in dimension d +1 
is a maximal nullspace of J in R4, 

9 — &(d) is the subset of the Grassmann manifold Geaa consisting of 
all self adjoint boundary conditions in dimension d + 1 in the sense (II). Let 
8:4,» = {k-planes p in R*|J|pXp—0}. Thus kd and Sas—b. 
Saat m {p € G04,% | e (mp) — ö(p) = k}. Here mı (72) : Re x Bi Ri Ri 
is the projection on the first (second) factor. Finally put 

S= {p E Scan | Tap Cc wip}. 
Then 8: C 8x C Goa, and 8g. is an open subset of Hoax. (All these 
a 
sets are given the topology induced by Geax.) Give U &x the topology in 
k0 
which a set is open if and only if its intersection with each of the 4» is open. 
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Define a map a: S >|) Sr by s($) =p where p is the essence of 8. 
0 


ad 
Lemma 4.3. (a) a: S —> U Gx is a homeomorphism. 
i k=0 
a 
(b) There is a continuous map 3: U &x—>& which is one-one onto. 
x0 . 
(c). There is a map pr: Boar U $, for each k=0,1,'  ',d. 
+k 


pr | Goan: Bean Ge is continuous (but p; is not continuous on Bran 


— ĝa). 
(d) $ is a submanifold of Gaa 


Remarks. 1. From (a) and (b) follows the existence of a one-one corres- 
pondence G: d— & which is continuous (but not a homeomorphism). 2. As 
in Section 2 we say that a broken C”? curve X in Rê satisfies the boundary 
condition SE ð at s if X has no break at s and there is ze Rê such that 
X (s) 8,2, X’ (s) == Sox. If P== G(S) € &, this is equivalent to demanding 
(X(s),X’(s)) €P. It is in this sense the two definitions I and II are 
equivalent, 


Proof of (a). sis one-one, for if s(S’) == p = a( 8), then 8’; == mp = Di, 
and (x,y) € p implies S'a (£) = y = Sa (2). Thus 9’, | S^ = S’ | S, = Sa | 8, 
which implies S’: = 8, by (B83). «4 is onto, for if p€ Yy let «7 (p) = (81, S2) 
where Sı = mp, and S, is defined on S, by Sss == y where (x,y) is the unique 
element in p such that m, (2,y) 7. S is extended to all of R? by the 
demand that (B3) hold. The defining property of &, will guarantee that 
this pair (81, 52) also satisfies (B2), and clearly s(8;, 82) == p. 

To show the continuity of a we first notice that any S€ 3 has a neigh- 
borhood U such that if 8’ € U, then 6(8’,) —=9(8,), and thus a: U> &, for 
some k. & C S(d) X S(d) and hence the (matrix) norm | | on S(d) 
induces a metric on 3, compatible with the topology on 8. 

Claim. For every sufficiently small e > 0 there is a ball Us C U of radius 
8 > 0 about 9, with the property that for every unit vector u € p—.(8) and 
for any S’E Us there exists a vector v’€ p’==.4(S’) such that |u—v | <e. 
This claim implies the continuity of a at S, as any frame spanning p can be 
approximated within e by a frame spanning p’. To prove the claim, let 
u= (a, 8.2) € p, |u|—=1 and SET, where U, CU is a ball of radius y 
about 8. Put v == (x, S'ar) when s= 8,2. Then 
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|v —u| S| a’—a2|.+ | 8'22’—S8,2 | 
=|8.—&||2|+18, |] —=]|+]8,— 8, le] 
Syt|Sslyt+yS@+/8| +y) 
which will be less than « if y < 8= min (1,./(8+|8])). 


We finally indicate why «t is continuous. For any fixed p€ &, and 
any sequence p,—> p in &, we wish to show that Sa == 4 (pa) > S = a> (p) 
in 3. Since p,—p clearly implies np > mp in Grex, Sin S, in S(d). 
Now SiS; in S(d) if and only if S,,v->S.v for all ve Rè. But 
v= Wn F wv’, =w p w where vw, = Spv and w= Sv, and hence 


Sond = Sant, + 0’, 2 Sov = Sew + vw’ 


if and only if Saws —> Saw. As (Wx, Senn) E Pn, (w, Saw) € p, and as pa—> p 
and #,— w, we conclude that Sent, > Siw, and hence that Sen > Se. 


Proof of (b). If pe Br, p is extended to PE & as follows. P= { (z, y) 
+ (0,2) | (2,y) € p. and z€(mp)+}. One checks directly that PE $, and 
this P is g(p). g is onto because every PE & can be written uniquely in the 
form P= {(z,y) + (0,2)|2,y€mP and z€(*,P)1}. The same formula 
shows g is one-one. The continuity of g is now a consequence of the fact 
that if p’ is sufficiently close to p in $y, then p’, = mp is close to p, and 
(p) + close to (pı) + in 1 Gar and Qaax respectively. ` 


Proof of (c). pr: Bear U & is defined by px(q) = p, : where 
15% 


p—mp—mg and p— {(2,y)| 2E p, and y= pz when (2,2) €g}. (p is 
well defined, for if (2,2) and (a,2’)€q, then (0,2—z)Eg. Take any 
T” € pi; then (2”,2”) Eq for some 2”€ Ri ge Hoax implies 


0 =J ((2”,2”), (0,z—2’)) = <2”, 2—7), 


showing y = pı2 = p7.) Similar arguments show pe &, for i = dp, =dm ıq. 
The continuity of pr | $°ca, is shown by arguments of the type used to prove 
(a) and (b). px is not continuous at any point of Boagx— Hoax, and it is 
these discontinuities which are responsible for the “strong focal points.” 


Proof of (d). We refer to Edwards [7]. 


4.6. Sprays and strong focal points. For a fixed (a,s,8) the set J*%g. 
is the linear space of all a-Jacobifields satisfying S (imposed) at s, which is 
of dimension d. J%g, is the linear subspace of J*%g, consisting of those 
Jacobifields X such that X(s)€S8, and ¥’(s)—S,X(s), or equivalently 
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(X(s),X’(s)) €p where p—=s($) is the essence of S. Hence d(J%y,) 
—4(9,) —3(p). 

Let qE Soa; Because 6%; E€ H, alq) € Boa; For fixed (a,s,q) the 
curve > ©%,(q): R'— Sea; is called the a-spray associated with g at s. 
It is a consequence of the continuity of the map ® that the spray map 
j: BPX RX RX 8243 Goaj is continuous. 3 is called the big spray. 
Next define Y: RE X RX RX 3—> 3B by ¥(a,8, t, 3) = sp; (a, s, t, (9) ) 
when j= 46(8;). (a,s,¢,9) is called the «-translate of the boundary condi- 
‘tion 8 from s tot. It is this “ pushing” which occurs in the index theorem 
of Ambrose, and it is completely determined for any t by the «-Jacobifields 
in J%g,. It is not transitive. We have broken it into a composition of several 
maps in order to prove the lemma below. The map p; is not continuous. . 
Thus ¥ will have certain discontinuities, the strong focal points. Explicitly, 
(a,8,¢,8) E Rt X RtX R XS is a strong focal point if 


;(a, 8, t,6(9)) E Bea; Bra, 


when 9(8,), = j; or, equivalently, if 8(p) >d(E°u(p)) when p—=s(8). 

set of strong focal points in RX R? X R! X æ is closed, and for fixed (a, 8, 9) 
the numbers ¢ for which (a,s,t, 8) is a strong focal point are isolated, [2]. 
Lemma 4.3 (a) and (c) now imply 


Lemma 4.4. If (st, S)ERRXRIXRIX ð is not a strong focal 
point, then Y: RFX RX RX d>D is continuous in a neighborhood of 
(a, 8, t, 8). 


Remark. Because of the one-one cones pondence G between 3 and $, 
there is an analogous map 

Y: ReX RX EX & OS: (a,8,t,P) > G(¥(a,s,¢,4*(P))). Strong 
focal points could be defined as above, but ¥ is not continuous even away 
from these. The reason is that G+: § —> $ is not continuous. 

The following example illustrates the discontinuities of Y. If e, - -, 64 
is a frame in RS, let (e, - ',es,81,° © °, 8a) be the frame of REX R? where 
a= (4,0) and &—= (0,4). Let P be the d-plane spanned by d,,' - -,8., 
P=L(d,°-+,84). Then mn(P)—0, and J|PXP—0, s Peg. If 
Q—L(e,' ' ',e), then QES and m (Q) =R? For any real number r 
put ,=L(d, +re,' ‚83-4 res). For all + near 0, P, lies in a neighbor- 
hood of Po =P in &, and m. (P,) = Rê when r40. Therefore the essence 
of P, is all of P, when r £ 0, while the essence of P, is just {(0,0)}. Assume 
we deal with one curvature function only, which is the constant map R: 
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Ri S(d): t-> Iq where Is is the identity map of R. The corresponding 
Jacobi equation is X”+X—0 (for a sphere) and the associated map 


Sor: RA- Rë: (x,y) > ((cost)# + (sint)y, (—sint)x + (cost)y). 
In particular, 
Gono: (ZY) > (Y,—2), and Porze (Pr) = L (e — ròn: > +, ea — trôa). 


Hence 7: (Pox/2 (P+) ) = Rå, and for all r, including 0, the essence of ®or/2 (P+) 

is dor/2 (P). We conclude that the translate of P,, W (0, 1/2, Pr), i8 Borza (Pr) 

if r£0, while Y (0, 7/2, Po) =Po. Since lim ¥ (0, t/2, P,) =Q, we have 
» 

shown that W(0,”/2,-) is not continuous at Po. In fact, the formulas 

above show that %’(0,t,-) is discontinuous at P, for all t.in an interval 

about 7/2. 


4.7. Continuity theorems. ‘Let 
B=(4,54,5,T)€¢RXRXEXS xX 3. 


Call r a conjugate point of B.if r is a conjugate point of the pair (8,7) in 
the Ambrose sense [2], where S and T are imposed at s and ¢ respectively, 
and the index form I» is defined on #(B) X # (B) by 


(X,Y) =i f (X, > — EX, F>) 
— <7. (t), Y (t)> + EZ, Y (8)>]. 


f>0 is continuous, and E(B) = {X € Z(s,t)| X (s) € I, and X(t) € Ty}. 
Z(B) does not depend on «. n(r,B) is the order of r as a conjugate point 
of B, and i(B) the index of Ir. 


THROREM 4.1. Select any B=(¢,3,t,8,T)€¢RXRXRXdxXSd 
and suppose s <1 <t. Suppose further that there are no conjugate points of 
B in the interval [tı,t.] except (possibly) r, where s<t,<r<te<t, and 
that J*%g,.\ 7%; {0}. Then there exists a neighborhood U of B such that 
for any BEU 

= n(v,B) =n(r, B). 


tı<o<ts 
THEOREM 4.2. If B= (a,s,t,8,T) is such that n(t, B) — 0, then there 
exists a neighborhood U of B such that for any BEU, 1(B) =1(B) and 
n(t,B) =n(t,B) =0. 


Proof of Theorem 4.1, assuming Theorem 4.2. Given B= (a,s,t, 9, T) 
the map: (,, T) > € (a, t, t T) =T;: R* X R! X 3 > £ is continuous in a 
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neighborhood V; of (a, t, T) (i=1,2) by Lemma 4. 4, because the assumption 
of Theorem 4.1 implies in particular that (a, t,t T) is not a strong focal 
point. Hence the corresponding map: 


BRXRIXRX3SXdö>RXREIXREIXÖXS: 
(a,8,1,8,T) > Bi (a, 8,1, 8, Ts) 


is continuous in a neighborhood U; of B. Combining this with the statement 
of Theorem 4. 2, we obtain the existence of a neighborhood U such that for any 
Be U, 1(B,;) =1(B,) and n(B,)=n(B,). Then from the Ambrose index 
theorem [2] follows 


n(r,B) =i(B,) —+(B,) =1(B,) —i(B) = E n(v,B) 
_ hots 
for any Be U. 





Proof of Theorem 4.2. B=(a,s,t,8,T) is fixed with n(t,B) =—0. 
Suppose the dimensions of S, and T, are m and n respectively. By Lemma 4.2 
there is a neighborhood N, of («,s,t) in REX Rt X R! and a sequence {t}, 
t==1,---,p, p>2, which is émnormal for the interval [5,7] for every 
(4, 5,%)€N,. Let 8(B) be the subspace of &(B) consisting of broken a- 
Jacobifields relative to the «-normal sequence {t}. Then the index and nullity 
of Ip on E(B) XZ(B) equal the index and nullity of Ip | 8(B) x B(B). 
We denote this restriction also by Iz, and prove (a) there exist a neighborhood 
V of B and for evey BE V an isomorphism 85:8, X Rex T,—> B(B); 
(b) the bilinear symmetric form ®5*(/3) depends continuously on BE FV. 


(a) and (b) imply Theorem 4. 2 because the eigenvalues of ©3* (Iz) = J3 
will depend continuously on B. Thus the assumption that n (t, B) = 0 implies 
that the eigenvalues of Jg are strictly positive or negative and hence will stay 
so in some neighborhood U of B. Hence the index i(Jz) =i(Jz) and the 
nullity n(Jx) == 0 = n(Jz) for all B € U, and this yields Theorem 4. 2 via (a). 


Proof of (a). Choose a neighborhood V of B such that BE V implies 
that {¢;} is an anormal sequence for [5,#] and that 0(8,) —8(9,) and 
(Tı) =ð (Tı). If V is sufficiently small, $, and 7, are close to S, and T, 
respectively in Ga, and Gan, and there are orthogonal projections pgg: SL — S, 
and prr: Tı—T which are isomorphisms. If 


a: (To, V1, ° j `, Tp, pir) ESX (Re)? X T,, 


define ©z: 8, X (REP X T,>3(B) by ®5(z) — unique broken &-Jacobifield 
X such that X has breaks only at the t; and X (5) = psg (z0), X (4) = ti 
(t—1,---,p) and X(f)—=Pprr!(2,.). This map is an isomorphism. 
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Proof of (b). Choose orthogonal bases @;,- > `, Gm bin,‘ ` "098 C1," ` *5 Cn 
of Sı, (R¢)? and T, respectively, and denote by the same letters the induced 
basis in 8,X (R?) X Tı. The form Jz is continuous if its coefficients 
relative to the basis a,---,¢, of 8, X (R*)?XT, are continuous. Let 
A,==@3(a,),--*. We must show the functions Jp (a, a) =15(4,4;), 
J3 (a, bm) = Iz (ån By), < + are continuous in B. For this observe that if 
X,Y € 8(B), then i 


? ; l 

I(x, Y) =f (8) (22 (tr) —X (t), Y (4)> 
+ <X'(#) — TX (t), Y (E) — <X' (5) 
Hence Jg (an a;) = f (&) <5,44(5) — 44 (5), A (3) > is continuous if A,(3) and 
Aj (5) are continuous in B. But A; (restricted to [5,1,]) is the unique &- 
Jacobifield which at 5 is pgg*(a:) and at t, is 0. Hence A,(5) = pas (%) 
and Aj(5) = Ezo (F) t o past (a) which do depend continuously on B 

in V. Similar arguments will show the continuity of Jz (tn bg), °°. 





SeX (5), ¥(5)>). 


Remarks. 1. Lf (s,¢) is not an a-conjugate pair the proof of Theorem 
4.2 could be simplified by the use of Theorem 3.3. 


2.- The topology on the boundary conditions used in the above theorems 
was the (geometric) one of the space 3. The following example shows there 
is no analog of Theorem 4.2 if we use the (coarser) topology of &. For 
- each positive real number r consider the self adjoint boundary conditions 
S, = (Is, (—1/r)Ia) where Is: R4— Rê is the identity map, and T = (0, Ja), 
imposed at 0 and 1 respectively. Let R: R189 (d) be identically 0. The 
corresponding index form J, on (4,0) X E(R4,0) is 


I(E, F) = fC BY) FEA te) RW), TC) 
—<(1/r)X (0) +2"(0), F(0)>. 


(This boundary problem arises from a straight line segment in R”! which at 
its left point is perpendicular to a sphere of radius + with opening to the right, 
and on:the right ends in a point.) The index #(I,)—=d and the nullity 
n(I,) =0, if 0<r <1, as is seen by finding the focal points of S, As 
r—>0 the plane P,—=G(S;) which is the boundary condition 8, considered 
as an element of &, approaches the limiting position {0} X R? = Q = G(T). 
Hence if B,— (0,1,P,,9) and B= (0,1,Q,Q) then B,>B in RX R! 
x&x%&. But i(Is)=0 =n(Is), and thus i(Iz) Alimi(I,) =d, even 
though n(Iz) =0. a 
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4.8. Ordinary conjugate points and continuity. In the simplest boun- 
dary problem, the fixed ends case, the continuity theorem 4.1 can be 
strengthened. If m and n are conjugate points along a given geodesic o, and 
if m is moved sufficiently slightly to the right along o to a position m’, then 
m’ has a conjugate point n’ which lies to the right of n on o. This fact was 
essentially proved by Morse [11]. The proof is based on the index theorem 
for this case and the continuity of the index form, and we do not repeat it 
here. We only give a precise statement. 


THEOREM 4.3. (Morse). Suppose (s,t) is a conjugate pair of order k 
along the geodesic o. For any given «> 0 such that there are no conjugate 
points of sin (t—«, t+ €) except t, there is a8 > 0 such that if ze (s,s + 8), 
there are precisely k conjugate points of z in (t,t-te). 
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MAXIMALE HOLOMORPHE UND MEROMORPHE 
ABBILDUNGEN, I.* 


Von KARL STRIN.İ 


Einleitung. Es seien X, Y, Y, komplexe Räume, f:X >Y und fo: 
X — Y, seien holomorphe Abbildungen. fo heisst von f strikt abhängig, wenn 
die durch die Zuordnung x— (f(z),fo(z)), zE X, bestimmte holomorphe 
Abbildung (f, fo): X—> F X F, in jedem Punkte von X den gleichen lokalen 
Rang wie f besitzt; f und fo heissen im engeren Sinne verwandt, wenn fa von 
f und f von fe strikt abhängig ist. Die Abbildung f heisst mazimal, wenn sie 
surjektiv ist und wenn jede von f strikt abhängige holomorphe Abbildung 
fi: X—Y’ eine Faktorisierung f=«(f)of mit einer holomorphen Ab- 
bildung a(f’): Y’— Y gestattet. Sind f und f, im engeren Sinne verwandt 
und ist f maximal, so wird das Paar (f,Y) als eine komplexe Basis zur 
Abbildung fo bezeichnet. 

Es hat sich gezeigt, dass die Begriffe maximale holomorphe Abbildung 
und komplexe Basis zu einer holomorphen Abbildung in mancher Hinsicht 
mit Nutzen verwendet werden können (vgl. [2, 13, 21, 23, 28]). Die wichtige . 
Frage nach der Existenz einer komplexen Basis zu einer vorgegebenen holo- 
morphen Abbildung ist in verschiedenen Arbeiten behandelt worden [15, 28, 
29, 30]. 

Die vorliegende Arbeit enthält weitere Beiträge zur Theorie der maxi- 
malen Abbildungen. Es wird eine weitere hinreichende Bedingung für die 
Existenz komplexer Basen zu gegebenen holomorphen Abbildungen angegeben, 
und es werden Eigenschaften maximaler holomorpher Abbildungen sowie 
spezielle Fälle diskutiert. Die Betrachtungen werden ferner auf meromorphe 
Abbildungen ausgedehnt. Es werden einige allgemeine Sätze über maximale 
meromorphe Abbildungen und im Zusammenhang damit Aussagen über 
Systeme abhängiger meromorpher Abbildungen bewiesen. Im Rahmen dieser 
Betrachtungen lässt sich durch Spezialisierung u.a. ein Satz von W. Thimm 
[34, 36] über die algebraische Abhängigkeit von abhängigen meromorphen 
Funktionen mit gemeinsamen Unbestimmtheitsstellen gewinnen.! 


* Received January 4, 1963. 

t The author was supported by AFOSR through the European Offico of Aerospace 
Research, US Air Force Grant No. AF-EOAR-61-50. : 

* Dieser Satz wurde auch von R. Remmert in [24], als Sonderfall einer aligemeineren 
Aussage über abhängige meromorphe Funktionen, neu gewonnen. Von P. Roquette wurde 
kürzlich der Satz von Thimm im Rahmen der lokalen Algebra formuliert und bewiesen. 
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Im einzelnen gliedert sich der vorliegende Teil I der Arbeit wie folgt: 

In 81 wird zunächst an wichtige Begriffe und Sachverhalte aus der 
Theorie der komplexen Räume erinnert (der Begriff komplexer Raum ist 
hier stets im Sinne der von J. P. Serre [27] gegebenen Definition gemeint). 
Nach einigen vorbereitenden Aussagen wird bewiesen (Satz I), dass zu einer 
holomorphen Abbildung f: X—Y eines irreduziblen komplexen Raumes X 
immer dann eine komplexe Basis existiert, wenn es in X eine analytische 
Menge A gibt, derart, dass die Beschränkung f| A eigentlich ist und den 
gleichen globalen Rang wie f besitzt. Spezialisierung auf den Fall A = X 
ergibt, dass zu einer eigentlichen holomorphen Abbildung f stets eine mit f 
im engeren Sinne verwandte maximale holomorphe Abbildung existiert. Diese 
letzte Aussage, und zwar in verschärfter Form, folgt unmittelbar auch aus 
einem Resultat von H. Cartan in [8]. Auf weitere Literaturzusammenhänge 
und auf Ausdehnungsmöglichkeiten der Aussagen wird am Schluss von $1 
hingewiesen. 

$2 handelt von Eigenschaften maximaler holomorpher Abbildungen. Es 
wird gezeigt, dass eine maximale holomorphe Abbildung stets einen Epimor- 
phismus der Fundamentalgruppen der beteiligten komplexen Räume induziert. 
Existiert zu einer vorgegebenen holomorphen Abbildung f: X>Y eine kom- 
plexe Basis (f*,Y*), so ist für manche Anwendungen die Frage von Be- 
deutung, wann der Raum Y* kompakt ist. Es werden einige Fälle betrachtet, 
in denen dies eintritt. Weiter wird eine Konsequenz aus Satz I angegeben 
(Proposition 2.3.1), die Ringe holomorpher Funktionen auf X und Y 
betrifft. Schliesslich wird auf Eigenschaften besonderer maximaler Abbil- 
dungen von Holomorphiehüllen komplexer Räume eingegangen. 

Maximale meromorphe Abbildungen werden im nachfolgenden Teil II 
dieser Arbeit behandelt. Zum Beweis der Hauptresultate wird eine Reihe 
von Vorbereitungen, unter anderem über holomorphe Korrespondenzen, er- 
forderlich sein. 


1. Maximale holomorphe Abbildungen. Eine Existenzaussage. 


1.1. Wir beginnen mit Bemerkungen zur Terminologie und erinnern an 
wichtige Aussagen. Hinsichtlich der nicht näher erläuterten Begriffe aus der 
Theorie der komplexen Räume und ihrer wesentlichen Eigenschaften sei 
insbesondere auf [8, 6, 7, 12, 26] verwiesen. 


Unter einem komplexen Raum X verstehen wir in dieser Arbeit stets 
einen komplexen Raum im Sinne von J. P. Serre [27] ?; alle vorkommenden 


? Eine allgemeinere Definition des Begriffes komplemer Raum wurde von H. Grauert 
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komplexen Räume werden als nichtleer und -endlich-dimensional voraus- 
‚gesetzt. Die komplexe Dimension von X im Punkte v € X wird mit dim, X be- 


zeichnet, die komplexe Dimension von X schlechthin ist dim X: — max dim, X. 
sex 


Ist A eine nichtleere lokal-analytische Menge in X, so induziert die komplexe 
Struktur von X eine komplexe Struktur auf A; A kann und soll immer’ auch 
als ein mit dieser Struktur versehener komplexer Raum aufgefasst werden 
und heisst dann ein komplexer Unterraum von X. Ist f: X— FY eine holo- 
morphe Abbildung, so ist die Beschränkung f | A: A — Y ebenfalls holomorph. 
Die komplexe Codimension von A im Punkte s€ A ist 


codim, A : = dim, X — dim, A, 


die komplexe Codimension von A schlechthin ist erklärt als die Zahl codim A 
: = min codim, A. 


wei 


Unter dem (lokalen) Rang r„(f) der holomorphen Abbildung f:X>Y 

im Punkte ze X wird die Codimension der Faser f!(f(z)) im Punkte z 

verstanden; die Zahl r (f) :— maz relf) heisst der (globale) Rang von f in X. 
we 


Ist re(f) = dim, X für alle z€ X (d.h. sind alle Fasern f-+(f(x)) diskret), so 
heisst f nirgends entartet. Sind fy: XY, (A=1,:: :,}) weitere holo- 
morphe Abbildungen von X, so nennen wir die durch die Zuordnung 
«— (fi(z),- + +, fi(%)) bestimmte holomorphe Abbildung 


8: X>YıX:''xXYı 


die Verbindung von fi,‘ -,fı und schreiben ®= (f,,---,f:). Die holo- 
morphe Abbildung fo: X—[Y, heisst von der Abbildung f strikt abhängig, 
wenn 1,(f) =rs((f,fo)) für jeden Punkt ze X gilt; f und fo heissen im 
engeren Sinne verwandt, wenn f von fo und f, von f strikt abhängig ist. Wir 
nennen ferner f, schlechthin von f abhängig—oder auch von. f abhängig 
im weiteren Sinne—wenn für jede irreduzible Komponente X’ von X 
r(f| X) =r( (f| X, f|X’)) gilt; f und fo heissen verwandt im weiteren 
Sinne oder auch analytisch verwandt, wenn f von f, und f, von f im weiteren 
Sinne abhängig ist.” Es gilt: fo ist genau dann von f strikt abhängig, wenn 
fo auf den Niveaumengen von f (d.h. auf den zusammenhängenden Kom- 
ponenten der Fasern f!(f(z)), sE X, von f) konstant ist; f ist genau dann 
von f im weiteren Sinne abhängig, wenn für jede irreduzible Komponente X’ 


in [10] gegeben; komplexe Räume im Sinne der Definition von J. P. Serre werden dort 
als reduziert bezeichnet. 

® Wir benutzen hier eine gegenüber [26], [29] und [30] etwas veränderte Termi- 
nologie. 
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von X fo | X’ auf den Niveaumengen von f | X’ der kleinsten vorkommenden 
Dimension konstant bleibt. Ist r(f.) —=1 und f, von f abhängig im weiteren 
Sinne, so ist f, von f sogar strikt abhängig. 

Wir sagen, die holomorphe Abbildung f: YY majorisiere die holo- 
morphe Abbildung fo: X —> Yo, wenn eine holomorphe Abbildung «a: Y — Y, 
mit fo-=-aof existiert. Die Abbildung f heisse marimal, wenn sie surjektiv 
ist und wenn sie jede von f strikt abhängige holomorphe Abbildung majorisiert. 
Sind f, und f im engeren Sinne verwandt und ist f maximal, so nennen wir 
das Paar (f, Y) eine kompleze Basis zur Abbildung fo. Jede weitere komplexe 
Basis (f, Y’) zur Abbildung f, ist mit (f,¥) biholomorph äquivalent, d.h. 
es gibt eine biholomorphe Abbildung 4: YY’, sodass f = of gilt. 

Ist die holomorphe Abbildung f: YY eigentlich, nirgends entartet, 
surjektiv und wird jede irreduzible Komponente von XY vermöge f auf eine 
irreduzible Komponente von Y abgebildet, so heisst f eine eigentliche Über- 
lagerungsabbildung und das Tripel (X, f,Y) eine analytische Überlagerung 
von Y durch X. Jede Faser f*(f(x)) ist dann endlich; ferner gibt es in 
X bezw. in Y je eine nirgendsdichte analytische Menge My bezw. My, derart, 
dass f(Mx) = My und f*(My) = My gilt und dass die durch Beschränkung 
von f bestimmte eigentliche surjektive holomorphe Abbildung f: X— Mx 
—> Y — My lokal biholomorph ist. Ist Y = U Y® die Zerlegung von Y in 


irreduzible Komponenten, so besteht für y€ Y®— My die Menge f(y) 

jeweils aus der gleichen (endlichen) Anzahl 5% von Punkten; 6 heisst 

die Blätterzahl von (X,f,Y) über Y und b:=supb die Blätterzahl von 
i 


(X,f, Y) schlechthin (b kann endlich oder unendlich sein). 


Der komplexe Raum X heisst im Punkte ve X normal, wenn der Halm 
über x der Strukturgarbe der holomorphen Funktionskeime ein ganz abge- 
schlossener Integritätsring ist; X heisst normal schechthin, wenn X in jedem 
seiner Punkte normal ist. Zu jedem komplexen Raum X existiert eine 
analytische Überlagerung ('X, v, X) mit der Blätterzahl 1 durch einen nor- 
malen komplexen Raum ’X;; eine solche analytische Überlagerung heisst eine 
Normalisierung von X (vgl. hierzu [7, 12, 18, 19]). Zwei Normalisierungen 
(X,v,X) und (X,,»,X) sind stets biholomorph äquivalent, d.h. es gibt 
eine biholomorphe Abbildung a: X — "X, mitvr=»,04u. Hine Normalisierung 
(X, v, X) ist speziell auch eine eigentliche Modifikation von X (vgl. hierzu 
§ 4 dieser Arbeit). 


1.2. Wir stellen einige im folgenden benötigte einfache Aussagen 
zusammen. 


t 
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PROPOSITION 1.2.1. Set f: X->Y eine holomorphe Abbildung, A eine 
nichtleere lokal-analytische Menge in X. Dann gilt »(f| A) Sr(f). 


Beweis. Es genügt, X und A als irreduzibel anzunehmen. Sei v ein auf 
A liegender Punkt von X und U eine offene Umgebung von x m X mit 
abzählbarer Topologie; dann ist U’:=UNA eine in A offene Menge mit 
abzählbarer Topologie. Die Bildmengen f(U) und (f|A)(U’) =f(U’), 
aufgefasst als topologische Unterräume von Y, haben jeweils die topologische 
Dimension 2r(f) bezw. 2r(f |4) (vgl. [26], Satz 1). Da f(U’) in f(D) 
enthalten ist, muss notwendig r(f| A) <r(f) gelten. 


PROPOSITION 1.2.2. Set X ein irreduzibler komplexer Raum, A eine 
nichtleere analytische Menge in X,f: X—Y eine holomorphe Abbildung, 
derart, dass f| A: A>Y eigentlich und r(f)=r(f| A) ist. Dann. ist 
f(A) =f(X), und f(X) ist eine r(f)-dimensionale irreduzible analytische 
Menge in Y.* 


Beweis. X darf als normal vorausgesetzt werden (nötigenfalls ist zu 
einer Normalisierung (’X,v,X) überzugehen und ’X,’A:=v!(A), f:=fov: 
’X>Y an Stelle von X, A, f zu betrachten). Weiter darf angenommen 
werden, dass A irreduzibel ist. 

Sei X’ bezw. A’ die Menge derjenigen Punkte von X bezw. A, in denen 
der lokale Rang von f bezw. von f| A gleich dem globalen Rang r(f) bezw. 
r(f| A) ist; X’ und A’ sind jeweils in X bezw. in A nichtleer, offen und 
zusammenhängend. Wir behaupten zunächst, dass der Durchschnitt 4”: 
=X’ A’ nichtleer ist. Träfe dies nicht zu, so würde X—X’DA gelten. 
X— X’ = :N ist eine analytische Menge in X (vgl. [22]) ; sei N, eine von 
denjenigen irreduziblen Komponenten von N, die A enthalten. Nun gilt 
r(f) 2r(f | Mo) +2; andererseits folgt aus Proposition 1.2.1, das 


r(f| Mo) 2 r((f| No) | 4) —r(F| A) 


ist. Also wäre r(f) >r(f| A), im Widerspruch zur Voraussetzung. . 

Sei jetzt A* die Menge derjenigen Punkte von A”, in denen A irreduzibel 
ist; A* ist eine in A offene und dort dichte Menge. Wird der (normale) 
komplexe Raum der analytische Primkeime von Y mit ®(Y) bezeichnet 
(vgl. [6, 7, 30]) und ist ry: &(Y)—Y die Projektion von &(Y) auf F, 
so gibt es holomorphe Abbildungen f: X’-> G@(Y) und ff: A">6G(Y) mit 
f| X =rrof bezw. f|A*—rroft, und zwar sind jeweils P(X’) und 


‘Vel. hierzu [24], p. 894 (Lemma), wo für Räume mit abzählbarer Topologie eine 
weitergehende Aussage bewiesen ist. 
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{*(A*) nichtleere offene zusammenhängende Mengen in r(f)-dimensionalen 
Komponenten G” bezw. G* von &(Y). Da f|A als eigentlich und r(f) 
—=r(f| A) vorausgesetzt ist, ist nach R. Remmert [22] die Menge B: 
—=f(A)CY eine r(f)-dimensionale irreduzible analytische Menge in Y; 
(@*,rr | @*,B) ist eine Normalisierung des komplexen Unterraumes B von 
Y. Sei nun z, irgendein Punkt von A*, dann ist der durch f*(z,) repräsen- 
tierte r(f)-dimensionale analytische Primkeim notwendig in dem durch f (zo) 
repräsentierten r(f)-dimensionalen analytischen Primkeim enthalten. Also 
ist f*(zo) =f (zo) und infolgedessen G’—G*. Dies bedeutet, dass f(X’) 
in f(A) = B enthalten ist; da aber X’ in X dicht liegt und B als analytische 
Menge abgeschlossen in F ist, muss dann auch f{X)C f(A) gelten. Ander- 
erseits ist wegen A C X natürlich F(A)C f(X). Mithin gilt f(A)=f(X). 


PROPOSITION 1.2.3. X, Y seien nichtleere topologische Räume; Y sei 
lokal-kompakt; f: X—Y set eine Abbildung, derart, dass jede Faser !(f(x)), 
xE X, in jeweils endlich viele zusammen hängende Komponenten zerfällt. Für 
jede positive ganze Zahl l set M, die Menge derjenigen Punkte yEY, für 
welche f*(y) höchstens | zusammenhängende Komponenten besitzt. Dann 
gibt es eine ganze Zahl lọ, sodass M, für L= l, in einer offenen Menge EAD 
von Y dicht liegt. 

Da M,C My, und ME gilt, folgt die Aussage unmittelbar aus 


dem Theorem von Baire. 
1.3. Zum Beweise des folgenden Satzes I benötigen wir 


PROPOSITION 1.3.1. Voraussetzung. Sei 3 eine vermöge einer Ord- 
nungsrelation = gerichtete Menge; Y, (i€ X) seien komplexe Räume. Zu 
jedem Paar i,j E X mit ji gebe es eine eigentliche Überlagerungsabbildung 
ay: Yı—> Yj, derart, dass fiir kEX mit kSj stets an — apo ay gilt. Es 
existiere ferner ein komplexer Raum Y und zu jedem tE X eine eigentliche 
Überlagerungsabbildung dx: Y>Y,, sodass fiir. JSt stets = ayo p; ist. 
Weiter set U eine nichtleere relativ kompakte offene Teilmenge von Ý; es ser 
U: di (Ŭ) gesetzt (U, ist relativ kompakt und offen in Y;), und es be- 
zeichne ’ay: U;—> U; die durch Beschränkung von ay bestimmte Abbildung. 


Behauptung. Es gibt einen Index „ES, sodass 'ay für ip Sj Sit bi- 
holomorph ist. 


Der Beweis wird mittels vollständiger Induktion nach der Dimension 
des Raumes Y geführt. Die Behauptung ist offensichtlich richtig, falls 
dim Ý —0. Angenommen, sie sei bewiesen fiir Dimensionen bis n—1 
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(n>0). Sei jetzt dim Ý =n. Wir wählen eine relativ kompakte offene 
Teilmenge Ü* von Ý, in der Ü relativ kompakt enthalten ist; es werde 
U,*:—=:(U*) gesetzt, und es sei ay*: U;* > U;* (für j&t) jeweils die 
durch Beschränkung von ay bestimmte Abbildung. Wir weisen zunächst die 
Existenz eines Index je € X nach, derart, dass für ja S j&i die ay” sämtlich 
Homöomorphismen sind. Ü* hat nur mit endlich vielen irreduziblen Kom- 
ponenten von Y, etwa mit YH (u—1,---+,m) gemeinsame Punkte. Sei 
Ya: p(Ñ) und 4: ÝA F die durch Beschränkung von g; be- 
stimmte Abbildung; dann ist jeweils (Y™, 4,@, Y,) eine analytische Über- 
lagerung, etwa der Blätterzahl 5%. Da für j Si sicher 5, @ <b, gilt, gibt 
es einen Index jı, sodass für jı Sj St und p—1,- - -,m stets bjw — d,™ ist. 
Es folgt, dass in Y und Y,“ (j,<i) nirgends dichte analytische Mengen 
MW bezw. 1, existieren, sodass 


MO) = MO, (Fa — Mm) YM, 


gilt und dass jeweils YY —M, auf YM, (j £j Si) vermöge ay 
biholomorph bezogen wird. M@und M,™ sind entweder leer oder höchstens 
(n —1)-dimensionale komplexe Räume. Ist Ŭ* N MW (also auch U,* N M) 
nichtleer, so gibt es auf Grund der Induktionsvoraussetzung einen Index j, 
mit j,<j., derart, dass für 7, Sj Si stets OF MM auf 00 Myo 
vermöge der Beschränkung von a, biholomorph, also insbesondere bijektiv 
abgebildet wird ; ist Ü* n Mo (also auch U;* N M;) leer, so sei jo: = j}. 
Sei nun fo so gewählt, dass j. S jo für »—1,:--,m. Die &y* sind dann 
für jo Sj St bijektiv. Sie sind auch topologisch, da sie als nirgends entartete 
holomorphe Abbildungen insbesondere offen sind; mithin sind U,* und U;* 
homöomorph, falls jp. Sj S4. , 

Sei ('U,v,Up*) eine Normalisierung des komplexen Raumes U;,*; mit 
‘SD bezw. ,* seien die Strukturgarben von ’U bezw. U;* bezeichnet. “SO und 
die ©,* mit Jo & i können als analytische Garben über U,* aufgefasst werden, 
sodass DO, C O+ C’D für 9 S 7 St gilt; sie sind als solche kohärent (siehe 
[7,18], sowie [12], Satz 27). Uy, ist ein relativ kompakter offener Teilraum 
von U,*. Wäre nun die Behauptung nicht richtig, so würde es eine abzählbar 
unendliche total-geordnete Teilmenge Sy, SS" SWS: von S$ geben, 
derart, dass stets O,,* | Un in Orna” | Uj, echt enthalten ist. Dies stände aber 
in Widerspruch zu einem Satz von H. Grauert ([10], §2, Satz 8). Also 
existiert ein t, € X, sodass ’a,;: U,> U; für t Sj S i biholomorph ist, w. z. b. w. 

` Wir beweisen nun 

Satz I. Sei f: X—Y eine holomorphe Abbildung des irreduziblen 

komplexen Raumes X in den komplexen Raum Y. Es ezistiere eine analy- 
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tische Menge A in X, derart, dass die Abbildung f | A: A Y eigentlich ist 
und dass r(f | A) =r(f) gilt. Dann gibt es eine mit f im engeren Sinne 
verwandte maximale holomorphe Abbildung ff: X—>Y* auf einen r(f)- 
dimensionalen komplezen Raum Y*. 


Das Paar (f*, Y*) ist also eine komplexe Basis zur Abbildung f. 


Beweis. A darf als irreduzibel vorausgesetzt werden. Weiter darf ange- 
nommen werden, dass f surjektiv und dass F irreduzibel und r(f)-dimensional 
ist. Trifft dies noch nicht zu, so ist nach Proposition 1.2.2 jedenfalls 
f(A)=f(X):==’Y eine r(f)-dimensionale irreduzible analytische Menge in 
Y. Sei ’f: X—’Y die durch Beschränkung von f bestimmte holomorphe 
Abbildung; ’f ist mit f im engeren Sinne verwandt, hat die für f voraus- 
gesetzten Eigenschaften und ist surjektiv. f und Y können jetzt durch ’f 
und ’Y ersetzt werden. —Es mögen weiter die alten Bezeichnungen gelten. 

Wir betrachten nun Paare (f Yı), wo Y, ein irreduzibler r(f)-dimen- 
sionaler komplexer Raum ist und fi: X —> Y, eine mit f im engeren Sinne 
verwandte surjektive holomorphe Abbildung, die f majorisiert. Zwei Paare 
(fy Yi), (fi Yi) mögen ß-äquivalent heissen, wenn es eine biholomorphe Ab- 
bildung fy: Yi-—> Y; gibt, sodass fj—= ßyofi ist. Die Gesamtheit der £- 
Aquivalenzklassen ist eine sinnvoll definierte nichtleere Menge. Sind Bo, by’ 
zwei 8-Äquivalenzklassen, derart, dass für zwei Repräsentanten (fo, Yo), 
(fo, Yo’) von by und bọ gilt, dass f, von fo’ majorisiert wird, so schreiben wir 
bobo’. Die Relation < ist eine Ordnungsrelation; die auf diese Weise 
geordnete Menge der 8-Äquivalenzklassen werde mit ® bezeichnet. 

B ist vermöge der Relation < eine gerichtete Menge: Sind b,, be irgend 
zwei B-Aquivalenzklassen und (fı, Yı), (fz, Y2) Repräsentanten von bi, be, 
so ist die Verbindung (ff): XY. Y., eine mit f im engeren Sinne 
verwandte holomorphe Abbildung; es ist also r((fi,f2)) =r(f) =r(f | A) 
= 1 ( (fo fe)| A). Ferner ist (fa, f2) | A = (fi | 4,fe| A) mit fa | A und fa | A 
eigentlich. Nach Proposition 1.2.2 ist demnach (fi, fa) (A) = (fao fe) (X) 
==: Y, eine irreduzible r(f)-dimensionale analytische Menge in YF, X Fo. 
Es bezeichne f4: X— Y, die durch Beschränkung von (fı, f:) bestimmte 
holomorphe (surjektive) Abbildung; fa ist mit f im engeren Sinne verwandt 
unde majorisiert fi und f, (also auch f). Für die durch (fs Ys) repräsen- 
tierte 8—Äquivalenzklasse b, gilt daher b, Sb, und b; S bs. 

Wir repräsentieren nun die Klassen aus B durch Paare (fẹ Y:), wobei 
jetzt 1 eine zu 8 isomorph geordnete gerichtete Menge X. durchläuft, Zu je 
zwei Paaren (f,Y;), (fp Y;) mit i,j € und j St existieren dann (surjek- 
tive) holomorphe Abbildungen a: Y,>Y, aj: Yj>Y, ay: Y,>Y, mit 


11 
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f= aofi aof; unda—a,0a, Es ist auch f| 4 = aofi | A, daher ist 
fi| A stets eigentlich. Wegen der Verwandtschaft von f und f; ist weiter 
r(f) =r (fi) und r(f | 4) =r(fı | A), also r(fi) =r (fi | A). Nach Proposi- 
tion 1.2.2 ist mithin f(A) =fiı(X) =F, demnach ist fı| A surjektiv. 
woraus folgt—wiederum wegen f | A—=,0f,| A—dass œ eigentlich ist. 

Für jeden Punkt y€ Y ist die Faser F,:= (f | A)= (y) eine kompakte 
analytische Menge, die in endlich viele, etwa in c(y), zusammenhängende 
Komponenten zerfällt. Es folgt, dass für jedes i€ X die Menge a*(y) C Y; 
endlich ist: Wegen art(y) = fı(Fy) besteht sie aus höchstens c(y) Punkten. 
a; ist mithin eine eigentliche Überlagerungsabbildung und das Tripel (Y4, p Y) 
eine analytische Überlagerung von Y, etwa mit der Blätterzahl b; Wegen 
a= ajo &y (j&i) sind dann auch die ay eigentliche Überlagerungsabbild- 
ungen und die Tripel (F4, ay, Yj) analytische Uberlagerungen. 

Die Blätterzahlen b; müssen sämtlich unter einer endlichen Schranke 
bleiben. Sei nämlich M, für die natürliche Zahl ! die Menge derjenigen Punkte 
y€ Y, für welche c(y) SJ gilt. Nach Proposition 1.2.3 gibt es dann eine 
natürliche Zahl l, und eine nichtleere offene Menge E in Y, derart, dass M, 
in E dicht liegt. Andererseits existiert zur Überlagerung (F, a, Y) eine in 
Y dichte offene Menge FE, sodass über jedem Punkte von F; vermöge a; genau 
b; Punkte von Y; liegen. Der Durchschnitt My, N E; ist nicht leer. Für jeden 
Punkt 7 € Mi, E; gilt dann 6; ¢(¥) und c(¥) 5S lo, mithin ist stets b; S lo. 

Sei m€ X ein Index, sodass bm maximal ist; fiir m<j ist dann stets 
(Fi, %jm Ym) eine analytische Überlagerung der Blätterzahl 1. Es sei für 
mÆ j jeweils (Y; v Yj) eine Normalisierung von Y; Die Abbildung ajm: 
Y;— Ym lässt sich zu einer holomorphen Abbildung ’aj,:’Y;—>’Y liften, 
80das8 Qim O vy = vm O Ajim gilt (vgl. [26]) ; dabei ist "a, wieder eine eigentliche 
Überlagerungsabbildung. Da auch die Blätterzahlen der analytischen Über- 
lagerungen (’Y,v,Y;) sämtlich 1 sind, ist (’Y,’aim,’Ym) stets eine ana- 
lytische Überlagerung der Blätterzahl 1. Dann aber muss, da ’Y, und ’Y,, 
normale komplexe Räume sind, ’aj, biholomorph sein. Infolgedessen ist auch 
(CIm vO’ Gim", Y) eine Normalisierung von Y; Es sei œj: = vo’ apm 
gesetzt. Ist weiter jı € X beliebig, so gibt es ein j€ X mit mj und 7, Sj; 
sei hy, == aj ° hz- Für das System der komplexen Räume F, Ý :='Fm und 
der Abbildungen ay, ġ; sind dann die in der Voraussetzung von Proposition 
1.3.1 angegebenen Forderungen erfüllt. 

` Es sei jetzt Y* der (hier zunächst nur als Menge betrachtete) inverse 
Limes des durch die F, a bestimmten inversen Systems: Die Elemente von 
Y* sind geordnete Punktmengen y*:= {  ,yy°  }, TES, wobei yE Y, 


MAXIMALE HOLOMORPHE UND MEROMORPHE ABBILDUNGEN, I. 307 


und ay(y;) == y; für jt ist. Es seien ff: X>Y* bezw. u: Y* > Y, die 
durch die Zuordnungen 


o> {: ° sfila): +}, c€ X, bezw. y* == {- PaO oh Say 


gegebenen Abbildungen; man hat fj—y,of* und wymmayoy, falls j Si. 
Mit Hilfe von Proposition 1.3.1 ergibt sich nun: Zu jedem Element 
y={,y,° -} € Y* existiert jeweils in Y, eine relativ kompakte offene 
Umgebung Ui(yi3y*) von y, mit ayt(Uulys;y*r)) = Uil; y) für 7 St, 
sowie ein Index t)(y*) — io sodass fiir + S ji stets Ui(y,; y*) auf Oy(y;; 9*) 
vermöge a, biholomorph bezogen wird. Es folgt insbesondere, dass y* € f*(X), 
dass also f* surjektiv ist. Weiter folgt, dass die Menge y(U,(y;y*)) nicht 
vom Index i abhängt—sie sei mit V(y*) bezeichnet—und dass die durch 
Beschränkung von y; bestimmte Abbildung "u: V(y*) > Ui(yi3y*) für 
to(y*) St bijektiv ist. Vermöge der Abbildung ’y,,1+ werde nunmehr die 
Topologie und komplexe Struktur von U;(y,;y*) auf V(y*) übertragen. 
Insgesamt ist so, wenn y* die Elemente von Y* durchläuft, auf Y* eine 
Hausdorffsche Topologie und eine mit ihr verträgliche komplexe Struktur 
festgelegt. Y* wird auf diese Weise zu einem rein r(f)-dimensionalen kom- 
plexen Raum; die Abbildung ff: X —> Y* wird zu einer mit f im engeren 
Sinne verwandten (surjektiven) holomorphen Abbildung, und die y: ¥*—> Y; 
werden zu nirgends entarteten holomorphen Abbildungen. Wegen fı = y;0 f? 
werden alle f,, also auch f, von f* majorisiert; das Paar (f*, Y*) repräsentiert 
daher ein Element von 2. 

` Wir behaupten, dass f* eine gesuchte maximale Abbildung ist. Hierzu 
braucht nur noch gezeigt zu werden, dass f* jede von f strikt abhängige 
holomorphe Abbildung majorisiert. Sei ġa: X — Y, eine solche Abbildung. 
Die Verbindung ®:= (ff, ġa): {<> Y*xXY, ist mit f*, also mit f, im 
engeren Sinne verwandt, es ist daher r(@) —=r(f) —r(f | 4) =r(8]| 4); 
ferner ist ® | A mit f* | A eigentlich. Nach Proposition 1.2.2 ist demnach 
P(A) = (X) = : Y’ eine irreduzible r(f)-dimensionale analytische Menge 
in Y*X Y, Es bezeichne e: Y’—> Y die Injektion von Y’ in Y und 
$: X- Y” die durch Beschränkung von & bestimmte (surjektive) holomorphe 
Abbildung; ferner seien o* und oa die Projektionen von Y*xY, auf Y* 
bezw. Y,. Man hat f* —=o* 0¢0 6’, also wird f* von ® majorisiert. Es wird 
dann auch f von © majorisiert; dass Paar ($, Y’) repräsentiert mithin ein 
Element von B, und daher wird ® von f* majorisiert. Es folgt, dass die 
Abbildung o*oe: Y’’—Y* biholomorph ist. Es ist $’ =-= (o*oe)of* und 
weiter da == 040e0®, also gilt da= (04960 (o*oe)"!) of*. Demnach wird, 
wie behauptet, ġa von f* majorisiert. 
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KoRoLLArR 1 zu Satz I. Ist X normal, so auch Y*. 


In der Tat: Sei (’¥*,v*, Y*) eine Normalisierung von Y*; dann lässt 
sich f*: X — Y* zu einer holomorphen Abbildung ’f*: X >’Y™ liften, sodass 
Pr v* 0'f* gilt. ’f* ist mit f*, also mit f, im engeren Sinne verwandt. Wegen 
der Maximalität von f* gibt es eine holomorphe Abbildung „*: Y*—’Y* 
mit ’f* == u*of*. Es ist demnach f*—»* o p* o f*, woraus folgt, dass v* o u*: 
Y* Y* die Identität, also »* biholomorph ist. Y* ist daher normal. 

Es ist naheliegend, wie Satz I zu modifizieren ist, wenn die Voraus- 
setzung der Irreduzibilität für den Raum X fallengelassen wird: Man hat 
dann für jede irreduzible Komponente X’ von X die Übereinstimmung der 
globalen Ränge von f | X’ und f | (4 N X’) zu fordern. Der Beweis wird nur 
technisch komplizierter, er lässt sich im Prinzip aber ähnlich wie oben führen. 

Die analytische Menge A kann insbesondere mit X zusammenfallen. 
So ergibt sich das 


KOROLLAR 2 zu Satz I. Zu jeder eigentlichen holomorphen Abbildung 
f: XY existiert eine mit f im engeren Sinne verwandte maximale eigent- 
liche holomorphe Abbildung ff: X>Y*. 


Wir schliessen noch einige Bemerkungen an. 

1) Die Aussage des Korollars 2 ergibt sich auch aus dem folgenden 
Satz, den H. Cartan in [8] unter Verwendung des Hauptresultates von H. 
Grauert in [10] über die Kohärenz von Bildern analytischer Garben bewiesen 
hat: Sei f: X—>Y eine holomorphe Abbildung, derart, dass die Niveaumengen 
von f sämtlich kompakt sind; sei R die durch diese Niveaumengen definierte 
Aquivalenzrelation in X. Dann ist die auf dem Quotientenraum X/R definierte 
geringte Quotientenstruktur eine komplexe Struktur. Entsprechende Resultate 
für den Fall, dass X eine komplexe Mannigfaltigkeit ist, und in einen anderen 
Spezialfall wurden schon in [29] gewonnen. Aus dem zitierten Satz von H. 
Cartan folgt ausserdem, dass eine eigentliche maximale holomorphe Abbildung 
stets einfach ist, d.h., dass ihre Fasern zusammenhängend sind. 


2) Es ist möglich, Satz I wie folgt auszudehnen: Zu der holomorphen 
Abbildung f: X>Y werden spezielle Klassen von f strikt abhängiger holo- 
morpher Abbildungen betrachtet, und es wird gefragt, ob es in einer derar- 
tigen Klasse eine Abbildung gibt, die alle Abbildungen der Klasse majorisiert. 
Im Rahmen solcher Betrachtungen lässt sich dann auch ein Analogon zu Satz I 
für holomorphe Abbildungskeime auf komplexen Unterräumen eines kom- 
plexen Raumes gewinnen. Wir verzichten hier darauf, dies durchzuführen. 
Im Paragraphen 5 werden aber die entsprechenden Fragen für den ‘Fall 
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meromorpher Abbildungen erörtert. Der dort benutzte Begriff der Abhängig- 
keit meromorpher Abbildungen deckt sich im Spezialfall holomorpher Ab- 
bildungen mit der oben erklärten Abhängigkeit im weiteren Sinne. Daher 
wird mit den Ergebnissen des Paragraphen 5 insbesondere auch eine Antwort 
auf die Frage gegeben, was an die Stelle der Resultate dieses Abschnittes 1.3 
zu treten hat, wenn der bisher für holomorphe Abbildungen ausschliesslich 
benutzte Begriff der strikten Abhängigkeit ersetzt wird durch den allge- 
meineren Begriff der Abhängigkeit schlechthin. 


2. Eigenschaften maximaler holomorpher Abbildungen. Besondere 
Fälle. Die in den Betrachtungen dieses Paragraphen auftretenden komplexen 
Räume X, Y werden der Einfachheit halber stets als irreduzibel vorausgesetzt. 


2.1. Wir diskutieren zunächst eine topologische Eigenschaft maximaler 
holomorpher Abbildungen. 
Jede stetige Abbildung f: X—>Y induziert einen Homomorphismus 


fi: m (X, 20) > 7 (F, f(a)) der Fundamentelgruppen (2, € X sei ein beliebig 
‘ gewählter Bezugspunkt). Es gilt 


PROPOSITION 2.1.1. Istf:X— Y eine maximale holomorphe Abbildung, 


so ist der Homomorphismus f: m (X, £o) > m(F,f(%)) ein Epimorphismus. 


Beweis. Zur Untergruppe Hm (X, %)) = :U von m(Y,f(z.)) gibt es 
eine unverzweigte unbegrenzte Überlagerung (Y’,r,Y) von Y, derart, dass 
für einen Punkt yo’ € Y’ mit r(yo’) = f(z) =: Yo die’ Projektionsabbildung — 
r: ¥’—» Y einen Isomorphismus von m,(Y’,yo) auf U induziert. Y’ kann 
mit einer komplexen Struktur versehen werden und wird dementsprechend als 
ein komplexer Raum aufgefasst sodass r eine lokal-biholomorphe Abbildung 
wird. Die Abbildung f: Y— Y lässt sich wie folgt zu einer Abbildung 
F: X — Y liften. Ist ze X irgendein Punkt, so sei C(s œ) ein x, mit x 
verbindendes Kurvenstück. Vermöge f gebt Œ (zo, v) in ein Kurvenstiick €, 
in F mit yo =} (2) als Anfangspunkt über; ©, kann zu einem Kurvenstück 
€ in Y’ mit yọ als Anfangspunkt geliftet werden. Bezeichnet y’ den End- 
punkt von &,’, so werde jetzt f(x) :==y gesetzt. Es folgt auf Grund der 
Festlegung von Y’ leicht, dass y nur von v, nicht aber von der Wahl von 
€(z,x) abhängt. Demnach ist : X— Y’ eindeutig definiert, und es gilt 
f=rof. Da r lokal-biholomorph ist, ist f eine holomorphe und mit f im 
engeren Sinne verwandte Abbildung. Wegen der Maximalität von f existiert 
nun eine holomorphe Abbildung o: Y>Y’ mit f—=oof; man hat daher 
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f—rocof. Hieraus ergibt sich, dass o injektiv und lokal biholomorph ab- 
bildet ; infolgedessen ist f(X) —o(Y) — : Y” ein offener Teilraum von Y’, der 
vermöge r homöomorph auf Y bezogen wird. Dann aber muss notwendig Y” 
mit F’ zusammenfallen ; r: Y’— Y ist also ein Homöomorphismus und somit 
Uer(Y,f(z)), w.z.b.w. 


Folgerung. Ist die holomorphe Abbildung f: X>Y maximal und X 
einfach zusammenhängend, so ist auch Y einfach zusammenhängend. 


2.2. Wir gehen in diesem Abschnitt von der folgenden Situation aus: 
f: X>T sei eine holomorphe Abbildung, zu der eine komplexe Basis (f*, Y*) 
existiert. Es sollen Fälle betrachtet werden, in denen der Raum Y* kompakt 
ist. In’einem solchen Falle ist dann insbesondere jede von f abhängige 
holomorphe Funktion konstant. 


Da eine maximale Abbildung stets surjektiv ist, ist Y* sicher dann kom- 
pakt, wenn X kompakt ist. Allgemeiner folgt die Kompaktheit von Y* auch 
dann, wenn in X eine kompakte analytische Menge A existiert, derart, dass 
wie in Satz I die Abbildung f| A: A—Y den gleichen globalen Rang wie f - 
in X hat. Dann ist auch r(f*) —r(f* | A); nach Proposition 1.2.2 ist daher 
f*(A) = f* (X) = Y* und infolgedessen Y* kompakt. 

In manchen Fällen lässt sich zeigen, dass die Dimension von Y* mit 
dem globalen Rang von f übereinstimmt. Z.B. trifft dies zu, wenn f die 
Voraussetzungen von Satz I erfüllt, oder auch, wenn der lokale Rang von f 
konstant ist (vgl. [30]), ferner, wenn X abzählbare Topologie hat. Ob 
allgemein r(f) = dim Y* gilt, muss offen bleiben; wir wollen es hier für die 
folgende Aussage voraussetzen.—Es sei y: Y*— Y die holomorphe Abbildung, 
für welche f =— y o f* gilt. Für jede natürliche Zahl k seien weiter mit H(X), 
H;(Y), Hı(Y*) die k-ten ganzzahligen Homologiegruppen von X, F, Y* 
bezeichnet. Man hat durch f, f*, y induzierte Homomorphismen 


fr: H,(X) > H,(Y), fit: H(X) > H,(Y*), yr: H,(¥*) > I, (Y) 
mit fr — yko fr”. Es gilt nun: 


Seir:=r(f) der globale Rang von fin X. Ist dann fa: Hy(X) > H,,(Y) 
nicht der Nullhomomorphismus, so ist Y* kompakt. an 


Zum Beweise hat man zu benutzen, dass für einen irreduziblen komplexen 
Raum der Dimension n die 2n-te ganzzahlige Homologiegruppe genau dann 
die Nullgruppe ist, wenn der Raum nicht kompakt ist ([4]). Jm vorliegenden 
Fall ist n = dim F+ =r. Wäre nun Y* nicht kompakt, so wäre Ho,(Y*) =0. 
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Wegen far — or © far* müsste aber dann fs, notwendig der Nullhomomorphismus 
sein, entgegen der Voraussetzung. 

Es sei.nun weiter X als normal vorausgesetzt, und Y sei die Riemannsche 
Zahlenkugel P+; die holomorphe Abbildung f: X—P"! ist also eine mero- 
morphe Funktion ohne Unbestimmtheitsstellen. f*: X— Y* existiert dann 
stets, und Y* ist eine Riemannsche Fläche. Wir behaupten: Gestattet f 
keine Darstellung als Quotient tetlerfremder holomorpher Funktionen in X, 
so ist Y* kompakt. In der Tat, wäre Y* nicht kompakt, so liesse die auf Y* 
meromorphe Funktion y: Y*— FP", für welche f=yof* gilt, eine teiler- 
fremde Quotientendarstellung y=yo/yı mit holomorphen Funktionen yo, yı 
‘zu; dann aber hätte man in f—y,.of*/y~,°f* eine Darstellung von f als 
Quotient der in X teilerfremden holomorphen Funktionen yo f* und y; 0 f*.— 
Es folgt, dass unter der angegebenen Voraussetzung über f jede von f 
abhängige meromorphe Funktion (die dann ebenfalls keine Unbestimmtheits- 
stellen aufweist) von f algebraisch abhängig ist (vgl. hierzu auch 86 in Teil 
II dieser Arbeit). 

Eine meromorphe Funktion mit Unbestimmtheitsstellen definiert lediglich 
eine meromorphe Abbildung in den P*, zu der eine maximale meromorphe 
: Abbildung auf eine kompakte Riemannische Fläche gehört. wie sich aus den 
Resultaten der folgenden Paragraphen ergeben wird. 


2.3. Wie in 2.2 sci f: X— Y eine holomorphe Abbildung, zu der eine 
komplexe Basis (f*, ¥*) existiert. Es sei wieder y: Y*— Y die holomorphe 
Abbildung mit f—=yof*; y ist nirgends entartet. Mit R(X;f) werde der 
Ring der von f abhängigen holomorphen Funktionen auf X bezeichnet. Wegen 
der Maximalität von ff: X— Y* existiert zu jeder Funktion pE R(X ;f) 
eine auf Y* holomorphe Funktion ¢* mit ¢—¢*of, und umgekehrt be- 
stimmt jede auf Y* holomorphe Funktion ¢* eine holomorphe Funktion 
pie gp ofEeR(X;f). Somit induziert f* eine bijektive Abbildung *f*: 
R(Y*)—>NR(X;f) des Ringes der auf Y* holomorphen Funktionen auf den 
Ring R(X;f), und diese Abbildung ist ein Isomorphismus. 


Ist nun y surjektiv und eigentlich, so ist (Y*,y,Y) eine analytische 
Überlagerung von Y, etwa der Blätterzahl b. Weiter mögen X und Y 
als normal angenommen werden (woraus folgt, dass Y* ebenfalls normal 
ist). Der Ring R(Y*) kann dann als ein ganzer Ring endlichen Grades 
[R(¥*): R(¥)] über dem Ring R(Y) der auf Y holomorphen Funktionen 
aufgefasst werden mit [R(Y*): N(Y)] Sb. y ist insbesondere dann sur- 
jektiv und eigentlich, wenn f surjektiv ist und ausserdem die Voraussetzungen. 
von Satz I erfüllt sind. Demnach gilt 
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PROPOSITION 2.3.1. Sei f: X—>Y eine holomorphe Abbildung des 
arreduztblen normalen komplezen Raumes X auf den normalen komplexen 
Raum Y. Es ezistiere eine analytische Menge A in X, derart, dass die Ab-' 
bildung f | 4: A>Y eigentlich ist und dass r(f | A) =r (f) gilt. Dann ist 
R(X; f) zu einem ganzen Ring endlichen Grades über R(Y) tsomorph. 


2.4. Es soll weiter auf eine Eigenschaft besonderer maximaler Abbil- 
dungen von Holomorphiehüllen komplexer Räume eingegangen werden. Die 
auftretenden komplexen Räume werden sämtlich als irreduzibel und normal 
vorausgesetzt. oO 


Sei r:’X—X eine nirgends entartete holomorphe Abbildung, es sei 
dim X = dim’X; das Tripel (’X,7,X) heisst ein Gebiet über X. Bezeichnet 
A eine Menge holomorpher Abbildungen «:’X¥—Z., von ’X in komplexe 
Räume Za, so lässt sich (’X,7,X) eine Holomorphiehiille H (CX, r, X); A) 
zuordnen (vgl. [14]), und zwar ist H((’X,7,X);M) ein Gebiet (X, c, X) 
über X mit folgenden Higenschaften: a) Es gibt eine nirgends entartete holo- 
morphe Abbildung a: ‘XY —>”X mit r = v 0 p, derart, dass jede Abbildung a € X 
vermöge p nach ”X holomorph fortsetzbar ist (d.h. zu a:’X — Ze existiert 
eine holomorphe Abbildung 8: ”X > Za mit a= fop). b) Ist (’Y,&,X) ein 
Gebiet über X und gibt es eine nirgends entartete holomorphe Abbildung 
n:'X>'Y mit r=£0n, sodass jede Abbildung «€ X vermöge y nach ’F 
fortsetzbar ist, so existiert eine holomorphe Abbildung: y:’Y >”X mit 
p=Won—Ist insbesondere o:”X— X biholomorph, so kann ”X mit X 
identifiziert werden; wir schreiben dann H(('X, r, X); X) =X. 

Es sei nun: eine maximale holomorphe Abbildung f: X—> Y von kon- 
stantem lokalen Rang gegeben. Die holomorphe Abbildung f:=for:’X>Y 
hat dann ebenfalls konstanten lokalen Rang, mithin existiert zu ’f eine kom- 
plexe Basis (’f*,Y*) (vgl. [30]). Es ist also ’f*: ’X—>Y* eine mit ’f im 
engeren Sinne verwandte maximale holomorphe Abbildung, und man hat 
eine holomorphe und insbesondere nirgends entartete Abbildung r*: Y* > Y 
mit ’f—=r*o’f*. Demnach ist (Y*,r*,Y) ein Gebiet über F. Sei jetzt 
weiter %* eine Menge von holomorphen Abbildung a*: Y*— Zas, derart, 
dass alle Abbildungen a*o’f*:’X > Zas zu X gehören. (Besteht z.B. M aus 
allen holomorphen Abbildungen von ’X in einen festen komplexen Raum Z, 
80 ist die Menge aller holomorphen Abbildungen von Y* in Z eine zulässige 
Menge %*.) Wir behaupten: 


Ist H((X,7,X); U) = N, so ist H((¥*,r%, Y) ;U*) =F. 
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Zum Beweise geniigt es zu zeigen, dass jede holomorphe Abbildung 
a*: Y*—> Zas aus W* vermöge r* nach Y holomorph fortsetzbar ist. Die 
Abbildung e* o’f*:’Y—> Za» gehört zu X, daher ist sie vermöge r zu einer 
holomorphen Abbildung a): X — Za. fortsetzbar; es gilt also a*o’f* = a,0r. 
Die Abbildung «* o’f* ist von ’f*, also auch von ’f abhängig; es folgt, dass 
in der offenen Menge r(X)C X die Fortsetzung a, von a*o’f* von der 
Fortsetzung f von ’f abhängig ist. Da f konstanten lokalen Rang hat, muss 
dann a in ganz X von f abhängig sein. Wegen der Maximalitét von f 
existiert somit eine holomorphe Abbildung æt: Y>Zu mit æo = a*of. 
Man hat a*¥o’f*—a,or==a@)"ofor, wegen for—'f—r*o’ffalso at o’f* 
= 0,*0r*0’f*, und hieraus ergibt sich @*==a,*or*, da ’f* surjektiv ist. 
Demnach ist a,* eine gesuchte Fortsetzung von «* vermöge r* nach Y. 

Wir wollen noch den besonderen Fall betrachten, dass Y eine nicht- 
kompakte Riemannsche Fläche ist (der lokale Rang von f: X — Y ist also 1), 
dass ferner Y mit dem Ring R(’X) der in ’X holomorphen Funktionen und 
A* mit dem Ring R(Y*) der in Y* holomorphen Funktionen zusammenfällt. 
Dann ist auch Y* eine nichtkompakte Riemannsche Fläche und somit eine 
holomorph vollständige komplexe Mannigfaltigkeit. Es muss also 


H((¥*, 7%, Y); R(Y*)) = (7°, 9,7) 


gelten, während unsere obige Aussage lehrt, dass H((Y*,r*, ¥) ;R(¥*)) == 
ist. Demnach ist r* surjektiv und biholomorph, und Y* kann mit Y 
ziert werden. Es ergibt sich: 


Ist f: X>TY eine maximale holomorphe Abbildung von X auf eine 
nichtkompakte Riemannsche Fläche, ferner (’X,r,X) ein Gebiet über X mit 


H(((X,7,X);RCX)) =X, so ist auch die holomorphe Abbildung for: 
"X —> Y maximal. 
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» DIFFERENTIABLE PERIODIC ACTIONS ON E° WITHOUT 
FIXED POINTS.* 


By J. M. KISTER. 


Smith has shown [5] that any map 7 on Er having a period a power 
of a prime must have a fixed point. Also, if n < 7 and the period of T is a 
product of two primes then T must have a fixed point providing T is differ- ` 
entiable [6]. Examples were outlined in [3] showing E’ admits a map 
of period + with no fixed points for each integer 1 not a power of a prime. 
These examples will be improved in this paper to show the second result 
mentioned above is virtually best possible, the single case n = 7 being unsettled. 
More precisely : 


THEOREM. If r is an integer which is not a power of a prime and 
n> then there is a differentiable and simplicial map of period + on F” 
without fixed points. 


Proof. If r is not the power of a prime, let += pq where p and q are 
relatively prime. Let S,’ and 8,’ be 1-spheres which are regular polygons 
of + sides centered at the origin in the 2-planes E,? and #,°, respectively. 
Define T, to be the rotation of E,? through 360/p degrees and T, to be the 
rotation of F through 360/q degrees.. Let E* be F,° X E.? and T be the 
orthogonal transformation T, X Tə. In E* there is a polyhedral 3-sphere 
denoted by S* defined by taking the union of all line segments from a point 
in 8,’ to a point in Sy‘. In fact 8° may be regarded in a natural way as the 
complex obtained as the join 8,’08,. Furthermore T (9°) = S? and T | 5° 
is simplicial, without fixed points and has period r. 

It is shown in 3.1 of [2] how to construct a map f: S°— 9° having 
degree 0 such that Tf=fT. Also, denoting the k-th barycentric subdivision 
of 8° by S*(%), f may be assumed simplicial from 8°(k) to S* for some k, 
ef. 5.5 of [2]. 

Let E,* and Æ,' be two copies of * containing as subeomplexes 
S*(k) = 5,3 and S*=S,* respectively, and let S” denote the -sphere in 
E = H,* X E.* consisting of all line segments joining a point in S,3 to a 
point in S. Then S* has the natural join structure of S*(k) oS, relative 
to which T X T is simplicial. 


* Received March 13, 1963. 
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Next we define an invariant 4-dimensional subeomplex C of 97 as follows. 
Order the vertices of S,’ by first listing the vertices in S*(k—1), then the 
barycenters of 1-simplexes in S?(k—1), ete., obtaining Vy, Va, © +, Vm and 
regard f as a map from S,* to 8,°. C consists of all closed simplexes spanned 
bY Vig? © <, Vip Fly) © °, f (V) Where io < i < t: < tis and 0 Sj 3. Then, 
since T preserves the ordering on the vertices of any single simplex in 8,°, 
and since f commutes with T, C is invariant under T X T which is simplicial 
on C. The complex C is a polyhedral form of the mapping cylinder deter- 
mined by f, and has S,° as a deformation retract. Also, since f is inessential, 
S,® can be contracted to a point in C, cf. 5.2 in [2]. 

Finally we subdivide 87 obtaining the new complex Sy" by taking the k-th 
barycentric subdivision of 8,°, say S,*(%), and letting the simplicial structure 
on S,’ be that of 8,?0 8,°(k). This induces a subdivision on C, say Cy, and 
TXT is still simplicial on both 8,’ and C4. 

Let p: Hit X Eż — Et X Ho‘ be defined by p(z,y) = (y,r) and let 
Cy’ = p(C,), the “reverse” of C, another invariant set on which T X T is 
simplicial. 

We note that 8," bounds a convex 8-cell D in E® which we triangulate 
by taking the cone over 8,’ from the origin. The next step will be to define 
an invariant 4-dimensional contractible (infinite) polyhedron K in D- 
{origin}. Let h; be the linear map of E° defined by h(z)=z/i+1. Let 
Sı be the polyhedron (8,7), += 0,1,2,---. Since TXT is orthogonal 
on E°, each ©; is invariant, as is hy(Cy), u(Cy’), h(S) and hy(S.3). Let 
Ij‘ be the cone over S, from the origin, j= 1,2. 

We obtain an invariant triangulation of D-{origin} by triangulating each 
annulus A, bounded by S; and S,.. This can be accomplished by starring 
each lateral face of each truncated 8-simplex o in A, and then adding a vertex 
at the center of gravity of o, without introducing any new vertices on the 
boundary of A. 

Then K is the subcomplex in this triangulation consisting of 
U [A(Cz) U (Ata NI *)], for all ¢ odd, together with U [hi(Cy’) U (AaNI))], 
for all positive even i. K is invariant under T X T since it is the union of 
invariant subcomplexes. T X T |K has period r and is without fixed points. 
Through successive deformations of the type that takes C onto 8% alter- 
nating with those taking the 4-dimensional annuli 4,NJ;* onto S N If it 
is possible to deform any finite subcomplex of K onto h,(S,*) for large odd i. 
Since ©," can be contracted to a point in C it follows that any finite sub- 
complex of K can be contracted to a point in K, hence K is contractible. 

Let U be the open star neighborhood of K in the second barycentric 
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subdivision of the triangulation of D-{origin}. Since the triangulation was 
invariant it follows thet U is invariant and T X T | U has period r and no 
fixed points. That U is homeomorphic to #* follows from: 


Lemma. If K is a contractible complex (possibly infinite) having co- 
dimension at least 3 in a combinatorial n-manıfold M, then the open star 
neighborhood U of K in the second barycentric subdivision of M is homeo- 
morphic to Er. 

Proof of the Lemma. Every closed simplex in Cl U is the joint of a sub- 
simplex in K with a subsimplex in Bd Ọ, hence every point in U—K deter- 
mines a unique line segment [z,y] in some simplex in CLU having one 
endpoint in K and the other in BdU. Parametrize linearly all such line 
segments in a continuous manner over U by ¢ values in [0,1] so that t==0 
corresponds to the end-point in K. Define +: U>K so that each of the 
half-open line segments is taken onto its end-point in K. 

Let Z be any subset of K and s be in (0,1). Define L(s) to be the set 
of all those points in w*(Z) whose ¢ value is no greater than s. Then if L 
is compact, L(s) is also. Next define a homeomorphism g,: U —> U, fixed 
on K, as follows. Consider a segment as before, parametrized by [0,1]. 
ge maps this segment piecewise linearly by taking [0,s] linearly onto 
[0,1—s] and [s,1] linearly onto [1—s,1]. 

Express K as the union of a sequence of finite subcomplexes {I4}. 
Since K is a deformation retract of U it follows that U is contractible, and 
since U is open in M it is a combinatorial manifold, hence we can use the 
corollary in [4] to get a combinatorial n-cell O, in U containing L, in its 
interior. : 

Let L,’ be a finite subcomplex containing L: U (C1). Use the corollary 
in [4] again to get an n-cell Cx in U which contains L,’ in its interior. Since 
C, is contained in L (1—s) and Lx (s) is contained in the interior of C; 
for small enough s, it follows that for some 8 g,(C’) will be an n-cell con- 
taining C, and L,(2/3) in its interior. Denote this n-cell by Co. 

Now proceed inductively getting n-cells {C;} in U such that C, C Int Cy, 
and Li +1) CC. Then U= Ü Ln(i/i+4) —UG and the last term 
is Er by [1]. This proves the Lemma. 

Finally, note that as an open set U inherits a differential structure from 
E° and relative to this structure TX T is differentiable, since TXT is 
orthogonal on &*. Also U can be given an invariant triangulation in the 
following way. Consider CLU as a subcomplex Q of the second barycentric 
subdivision of D-{origin}. Denote by U, the union of all closed simplexes 
in the barycentric subdivision Q, of Q which are contained in U. Denote by 
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Qə the subdivision of Q, obtained by starring all simplexes in Q, not in Uj. 

Let U, be the union of all simplexes in Q, contained in U. Continue on in 

this way getting U = U U, with each 7, invariant, and the collection of all 
4=1 

simplexes occurring in the U, give an invariant trangulation. 

That these specific differential and combinatorial structures are equiv- 
alent to the standard ones follows from [7]. This finishes the proof of the 
theorm forn—8. For E®x E*, define the action to be trivial on the second 
factor. 

For each odd p let Tap: 8?» S? be defined by Tap =T oTa” where 
T”: 8°—> 8° interchanges points and Tap”: S'—S' rotates through 360/p 
degrees. Then Tep has period 2p and no fixed point. 

COROLLARY. If f: 8S? S? is a map such that Topf = fT 2», for some p, 
then f is essential. 


Proof. If there is a map f and an odd p such that f has degree 0 and 
Taf = fT, then we assume (by taking the appropriate power of T) that 
p is prime, and the construction in the theorem can be redone using S° in 
place of S*. This results in a differentiable map of period 2p on E° having 
no fixed points. This contradicts the previously mentioned result of Smith [6]. 


Conjecture. It seems plausible that Topf—fTy. implies degree of 
f=+1(modp). 


UNIVERSITY OF MICHIGAN AND 
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A REFINEMENT OF VAN DER CORPUT’S THEOREM 
ON CONVEX BODIES.* 


By G. K. WHITE. 


1. Introduction, Let K be an open convex body in n-space, symmetric 
about O and with volume V (K). Let A be any lattice with determinant A340, 
Then according to an assertion of Blichfeldt [1], subsequently verified by Van 
der Corput [2], if V(K) > 2"kA (k=1,2,: : +) then K contains at least k 
pairs + P40 of points of A. ‘I observe that the ideas in his proof give, 
in fact, a little more information about the points in K: 


THEOREM A. If V(K) > k2"A, then there are k distinct points P£ 0 
(i=1,: ,k) of A such that 


OSD 2 PeK (i=1,;:,k), and 
(2) P,— Pye K (t,j=1,- g ihe) 


The following immediate consequences of Theorem A (for the case k == 2) 
may be of interest in application: 


(i) If the points of A other than O in K form a Eine independent 
set of tn pairs of points, then V(K) = ?r*!a. 


(ii) If all the points of A except O in K lie on two distinct hyperplanes 
E an= +00, then V(K) Sea. 


It may be remarked that the theorem can also be proved directly by a 
method of Mordell [3] which van der Corput [2] utilized to obtain his 
results. We offer a third proof, which has the advantage of giving additional 
information about the critical cases, and for this, it is convenient to have 
the main assertion in its negative form: 


THEOREM B. If there are at most k=1,2,- - - distinct points {0 == Po, 
Pa: © +, Pra} including O of A such that 
(3) l PEK (i=0,1,; : -,k—1), and 
(4) Pı— P;E K (i7 = 0,1,- + -,4—1) 


* Received January 11, 1963. 
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then 

(5) V (KE) Shara 

und V(K) == k2"A if and only if every grid of the form T=X-- A (where 
X is an arbitrary point in space) which has no point on the boundary of K, 
has exactly k2” points in K. 


Before proceeding to the proof, we consider some properties of lattice- 
coverings of space which will be useful in characterization of the critical 
cases in Theorem B. 


2. Lattice-coverings of bounded sets. In the course of our proof of 
Theorem B we shall use our main result (Theorem 1), which is applicable 
not only to K but also to more general bounded sets, and in preparation we 
introduce some symbols and definitions: 

Let S be any bounded set of content V=Y(8)>0, and for PEA let 
S(O) =8, S(P)=P-+8(0) denote the respective translated sets. We 
thus induce a multiple S-covering + 


P 
PNA ) 
of space, and for any point X we set 
k(X) = Cardinal {P: X€ 8(P)}. 


Since S is bounded, &(X) is bounded and integrable. Let M=M($,A) 
denote the maximum value of k(X). Then 


(6) 0<k(X) SM(S,A)=M 
for all X in space, and we may define 


(7) p=p(8, A) =1/7 f. k(x)ax, 


p representing the average density of the covering, taken over any one of the 
sets S (P). Clearly, 
(8) 1Sp SM. 


' Turorem 1. Let M I1 be any given integer and let A be a fixed lattice. 
Suppose that S is a bounded set in space with content V(S) >0 and with 
M(8,A)=M. Let Z denote the set of all Such S with fixed a A) =p, 
say. Then 


1 As distinct from an ordinary S-covering U S(P). 
Pea 


12 
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i = = == pA tf p is integral 
(9) sup?V(8) = (Lol +1)[6]4/(2L4] +1—p) | Tee 
where pM. Also, for any S in Z, 
(10) V(S) = pA tf and only if k(X) — pP: P3 


COROLLARY 1. Suppose that S is open and bounded, and that the 
boundary of S has content 0. Then (10) may be replaced by 


V(S) =pA if and only tf every grid of the form T= X + A(where X 
is an arbitrary point in space) which has no point on the boundary of 8, has 
exactly p points in S. 


COROLLARY 2. Suppose O €K and that S ts open, symmetric about the 
origin and bounded, und that the boundary of S has content 0, and let T 
be any one of the 2" grids of the form T=B-+A, with 2RBEA. Then in 
each limiting case V(S) —= pA, there are points of F on the boundary of S, 
when 

T = A, and p is even 
or when 
T44, and p ts odd. 


We note that since W(X) is integral, the limiting cases (10) can occur only 
when p is an integer. 

I should like to thank Dr. J. H. H. Chalk here for his valuable assistance 
throughout the preparation of this paper. 


8. Proof of Theorem 1. Without loss of generality, A is the lattice 
of points with integral coordinates. Then, employing the usual notation, 
A= Ao. The coordinates of any point X of space shall be denoted by 
(éu ',$n). For j any positive integer, we consider the half-open integral 
box 


By={X: —j/2S& < 9/2} (ai) 
and define 
Sm {X: k(X) =i} 
W; = ax t—0,1,---°,M 
‘ BOB (i ? | ) 
U; = ax. 
BNE: 


*The supremum is attained. 
»P-P (almost everywhere) shall be taken in this paper to mean “everywhere in 
space, except on a set whose intersection with any bounded region has content 0.” 
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We first show that 
(11) Uy ty (¢—0,1,-- +, Af). 


Since S is bounded, we may enclose it in some box B; If, for any m>j+1, 
we form the sum 


(12) E S(P) N S, 
PeBn 


points of 8; outside Bm, will not appear in (12), while those inside will be 
counted at most i times, points in By, being counted exactly + times. Since 
there are exactly iN*W, points of 9, inside By (N —1,2,-- -), we have 


i(m— j) Wi S m*U,Si(m + j)"W.. 


If we now let m—>oo, (10) follows. Next, we observe that clearly, 

13 W; and v=% f, k(X) dX. 

4 4 Bı 

Therefore the content V of 8 may be taken to represent the average density 
of the S-covering 2,8(P) of space. By (7), 

Pe 

v= f EZ) E EDET 
8 i Jans $ i 
We thus have, with a convenient change of notation, 
(13) Wi |m az? > 0, (i=0,1,: + +, M) 
(14) V = S in, pV = Der, 1- Ya? (i=0,1,; Er M). 
i ¢ i ; 


We now find the maximum V for fixed p, under conditions (14). First, 
suppose 2% 540. Then we may replace z? by y? =z} (1+6) (¢<=1,---,M) 
and 2? by yo? == 1—Sae(1 + e), for some e > 0, and thus obtain a larger F. 
So without loss of like we set 2 == 0, and rewrite (14) 

Vim Sic? 
(15) 0= E(P — pi) r? (t=~1,---,M), 

f Lm Sa? 
and for M > 2 we define 


M M 7 M 
EQ, p) = zie? FAD (Opi) ae +p Dae. 
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For the maximum of V under the restrictions 0 = X (F —p;)z?, 1 = X z, 
we have by the method of Lagrange multipliers. 


(16) - 0 = 0B / n= HI — pt) + p) a’. 


Since p is fixed, it is easy to see that the quadratic in ¢, i+ A(i?— pi) + p= 0, 
cannot be satisfied by three distinct values of 4. Thus there exist integers r, 8 
(1Z£r<s=M) for which z=0 unless i=r or s, and (15) becomes 


V = rg? + 832% 
(17) © O= (2 — pr) a2 + (8? —ps)a,? (1<£r<s<M) 
L= r? H T. 


We distinguish two cases: 
First, suppose that 0, z, 540. Then since 


0 = (r— p) rr? + (s — p) 8T? 


and 1&r <s, we have 


(18) r<p<s, 
and so r--s—p>0. Solving (17), we find 
(19) V=r18/(r-+8—p) | 
| —=p + (r—p) (s—p)/(r+58—p) 
(20) ` © <p by (18). i 


We rewrite (r—p)(s—p)/(r +8s—p)=— (p—r)/(1 +r(s—p)*). If we 
keep r fixed.and let s vary (p <s=<M), it is evident from (18), (19) that 
V will increase as s decreases, attaining its maximum at s = [p] +1. By a 
similar argument the maximum V for fixed s is at T= pl. Thus the 
maximum V is : 


(21) - vertybe +1—p) | 


under our first assumption that 2, ~0, £, 340. 
For our. second case, we suppose the contrary. Then without loss of 
generality »—0, and by (17), 1—2,? and 


(22) j . Y =r =p. 


Thus this case arises if and only if the sets {9 (P): PE Ao} cover space exactly 
r==p times, almost everywhere, and so (10) follows from (20), (22). By 
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(22), this occurs only for p an integer (r), so for non-integral p (21) gives 
the overall maximum of V, which is less than p by (20). For integral p, 
the expression in (21) is equal to p, and hence by (22) is again the overall 
maximum. We have thus verified (9), and our proof is complete. 


Proof of Corollary 1. Clearly, 
X€8(P) if and only if X—P € §(0) 8. 


So if we define N(T)) to be the number of points in g of the grid T = X + Ag, 
it is immediate that l 
(23) - N(T)—=k(Z). 


Assume now that k(X) —pP-P, and T does not intersect the boundary of 
any S(P) ; we deduce that N(T)==p. For X €T, X will be in exactly k(X) 
of the bodies 8(P), but not on the boundary of any. Since J is open, there 
clearly exists some neighbourhood N (X) of X with the same property. N(X) 
has non-zero content, so if V(9)= pA, we have by Theorem 1 that for 
every point Y in N(X), k(Y)—p. In particular, with Y =X we have 
N (T) = %(X) =p, by (28). 

Conversely, assume that for some positive integer k,.N (I) = k for every 
grid T which does not intersect the boundary of any S(P); we deduce 
k(X)=—pP-P. Let T be the set of all points X whose corresponding grid 
T == X-|- A, has the above property, and let T” be its complement. If X is 
in the unit box B., clearly X€ 7’ if and only if X lies on the boundary of 
some S(P): Only a finite number of the bounded sets S(P) can intersect 
B,, and the boundary of any S(P) has content 0, by the hypothesis of the 
corollary. Hence it follows that B, N T” has content 0, and k(X)=kP-P. 
It remains to show that k==p. We have 


Vs =f k(X)dX k(X)dX 

PO), DIE f K(x) 
=kV(SNTJ+HaV (ENT) (OSa HM by (6)) 
=kV(8) +0, since VY(B,NT)—=0. 

Thus kp, and a reference to Theorem 1 (10) completes our proof. 


- Proof ‘of Corollary 2. -Let T be of the form T = B +- A, where QBE A. 
Clearly XE'T implies 2X € A, and thus —X =— X +- (—2X)ET. Also eg 
implies —X € 8, since S is symmetric about the origin. Thus all points X 4 0 
of TN g occur in pairs (X,— X), and so since O € 8; the number of points 
of T must be odd for T = A, even otherwise. If we now assume we have a 
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limiting case V(S) = pA, and that there are no points of T on the boundary 
of 9, then there must be exactly p points of T inside S, by Corollary 1. Our 
result follows easily, by contradiction. 


4, Proof of Theorem B. Suppose V(K) > k2*A, and let K’ == $K, so 
that V(K’) > kA. Then by Theorem 1, with S = K’, 


kA < V(KR’) SpA Ssupk(X)A, 
x 
so there must be some point X contained in at least & +1 bodies 


K (Qi) (QE A, i= 0,1, ` k). 
Thus 


E (Qo) NE (Qa) N: > -N E (Qx) AD, 


where Qo, Q1,' ' °, Qk are distinct points of A. Clearly, from the symmetry 
and convexity of K, 


P= Qi—Q0EK(0) Ci 
P,—Py€ K(0) (t,7=0,1,-- +, k) 


contrary to our original hypothesis. Thus, 
V (KE) SkarA. 


The boundary of the convex body K is a single Jordan arc, and K is open. 
The remainder of Theorem B is thus a direct consequence of Corollary 1. 
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LIE GROUP REPRESENTATIONS ON POLYNOMIAL RINGS.** 


By BERTRAM Kosrant.? 


0. Introduction. 1. Let @ be a group of linear transformations on a 
finite dimensional real or complex vector space X. Assume X is completely 
reducible as a G-module. Let 8 be the ring of all complex-valued polynomials 
on X, regarded as a G-module in the obvious way, and let JC 8 be the sub- 
ring of all G-invariant polynomials on X. 

Now let J* be the set of all f € J having zero constant term and let H CS 
be any graded subspace such that S = J*S + H is a G-module direct sum. It 
is then easy to see that 


(0.1.1) S=JH. 


(Under mild assumptions H may be taken to be the set of all G-harmonic 
polynomials on X. That is, the set of all. f€ $ such that 6f—0 for every 
homogeneous differential operator 9 with constant coefficients, of positive 
degree, that commutes with G.) 

One of our main concerns here is the structure of S as a @-module. 
Regard S as a J-module with respect to multiplication. Matters would be 
considerably simplified if $ were free as a J-module. One shows easily that 8 
- is J-free if and only if S=xJ@H. This, however, is not always the case. 
For example S is not J-free if @ is the two element group {Z,—J} and 
dim X = 2. On the other hand one has 


Example 1. It is due to Chevalley (see [2]) that if GŒ is a finite group 
generated by reflections then indeed S—J@H. Furthermore the action of G 
on H is equivalent : Hie regular representation of G. 


Example 2. FR J-free in case G is the full rotation group (with respect 
to some Euclidean metric on X. For convenience assume in this example 
that dim X = 3). Note that the decomposition of a polynomial according 
to the relation S=J®H is just the so-called “separation of variables” 
theorem for polynomials. This is so because J is the ring of radical poly- 
nomials and H is the space of all harmonic polynomials (in the usual sense). 


* Received February 11, 1963. 
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š ve Now, for any z€ X, let Os CX denote the G-orbit of z and let S(O.) be 
al the ring of all functions on O, defined by restricting S to Os. Since J reduces 
to constants on any orbit it follows that (0.1.1) induces a G-module epi- 
morphism i 
(0.1.2) H>S(0.). 
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Since our major concern is the case where X is a reductive Lie algebra 
and @ is the adjoint group and since the methods used there belong to algebraic 
geometry we will assume now that X is complex and the @ is algebraic and 
reductive. . All varieties considered are over C. If Y has an algebraic struc- 
ture R(Y) will denote the ring of everywhere defined rational functions in Y. 
Obviously one always has 
(0.1.3) 8(0,) CR(O,). 


On the other hand if G? C G is the isotropy group defined by s€ X then one 
- has a G-module isomorphism 


(0.1.4) R(G/G*) > R(0.). 


The significance of (0.1.4) is that one knows the G-module structure of 
E(G/G*) completely by a very simple algebraic Frobenius reciprocity theorem 
(even though G* may not be reductive). In fact if V^ is any irreducible 
@-module with respect to the representation +> and V, is the dual module 
then one has 


(0.1.5) mult. of A in R(G/Ge) — dim Va” 


where V, is the space of vectors in V, fixed under G*. 


Now in Examples 1 and 2 (assume complexified) the following three 
optimum situations occur: 


(a) & is J-free so that S—J@H 
(b) the map H—8§(O,) is an isomorphism for certain s€ X and for 
those z 


(c) #(Oe) =8(0z). 


But one observes that if in any general case, (b) and (c) hold then, 
clearly, upon combining (0.1.4) and (0.1.5) one gets the G-module structure 
of H. If one gets in addition the “graded” G-module structure of H and 
knows the structure of J then one gets the full graded G-module structure 
of 8 in case (a) also holds. 

In Example 2 the conditions (b) and (c) hold for any 0 (even if 
(2,2) —0). In fact, classically, one has exploited (b) and (e) for (z,2) >0 
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to solve the Dirichlet problem with the sphere as boundary. That is, if f is 
any continuous function on the sphere one first expands f as a Fourier develop- 
ment of spherical harmonics fm. The sphere is Os N R” and the fm are in 
R(0,). The equality 2(O,) =8(0,) and the isomorphism H-> 8 (0+) then 
yields the extension of fm uniquely as harmonic polynomials m on X. But 
this yields the desired extension of f. 

In Example 1 the conditions (b) and (c) are satisfied for any “regular” 
element z€ £. 

Our first concern in this paper is to give criteria for (a), (b) and (e) 
to hold in general. Since our interest is in the continuous case we will assume 
G is connected (and hence a variety). Thus Example 2 rather than Example 1 
serves as a model. 

Now let PC X be the cone of common zeros defined by the ideal J*8 
in 8. Let X* be the dual space to X and let P* C X* be defined in a similar 
way with the roles of X and X* interchanged. Asa criterion to establish (a) 
and more we prove 


PROPOSITION 0.1. Assume (1) that J+8 is a prime ideal in S and (2) 
there exists an orbit O, C P which ts dense in P. Then 8 ==J QH. Further- 
more tf G is a subgroup of the complex rotation group then H may be taken 
as the space of all G-harmontc polynomials. Moreover H then coincides with 
the space spanned by all powers f* where fE P*. 


It may be observed that the criterion is satisfied in Example 2. 


An element z€ X is called quasi-regular if PCC*- Os. A criterion to 
establish (b) is given by 


PROPOSITION 0.2. Assume conditions (1) and (2) of Proposition 0.1 
are satisfied. Then the G-module epimorphism H —> 8(O,) is an isomorphism 
for any quasi-regular element zE X. 


It may be observed that in Example 2 every nonzero EX is quasi- 
regular, i 


From known facts in algebraic geometry one has the following criterion 
to insure (c). 


Proposition 0.3. Letse X and assume (1) the closure Og is a normal 
variety and (2) Ös— 0, has a codimension of at least 2 in Oy Then 
B(Oz) = 8 (03). 

It may be observed that the conditions of Proposition 0.3 are satisfied 
for every z€ X in Example 2. 
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Now assume that X =g is a complex reductive Lie algebra and @ is the 
adjoint group. Here the structure of J is given by a theorem of Chevalley. 
This aserts that J is a polynomial ring in ! (the rank of g) homogeneous 
generators t4, i=-1,2,---,12 with dgw=m; +1 where the m, are the 
exponents of g. 

Now one knows that here P is the set of all nilpotent elements of g 
([13], Theorem 9.1). But then by [13], Corollary 5.5, P does contain a 
dense orbit O., namely, the set of all principal nilpotent elements ing. Thus 
to apply Propositions 0.1 and 0.2 one must prove that J*S is a prime ideal. 

If n == dim g (all dimensions are over C) then one sees easily that n— I 
is the maximal dimension of any orbit. Let r= {z€ g | dim0,—n—l}. 
Any regular element v€ g belongs to r. But also sEr for any principal nil- 
potent element. These in fact are extreme cases. 


Proposition 0.4. Let zeg be arbitrary. Write (uniquely) s =y -+z 
where y is semi-simple, z is nilpotent and [y,2]—=0. Let gv be the centralizer 
of y in g so that g is a reductive Lie algebra and z€ gv. Then zer tf and 
only if z is principal nilpotent in g. 

Let rEg. Consider the values (du), of the Ldifferential forms dw, 
t==1,2,---,l, ata. Itis known that these covectors are linearly independent 
whenever z is regular. (One recalls that the product of the positive roots is 
the determinant of an ZX l minor of a certain n X I matrix determined by 
the dw.) But to prove the primeness of the ideal J*+S one needs to know that 
these covectors are linearly independent if z is a principal nilpotent amt 
This fact is contained in 


THEOREM 0.1. Let zeg. Then the (du). is linearly independent tf 
and only if zer. A 
Proposition 0.1 may now be applied. 


THEoREM 0.2. One has S=J®H where H is the space of all G- 
harmonic polynomials on g. Furthermore H coincides with the space of all 
polynomials spanned by all powers of “nilpotent” linear functionals. 


Since Theorem 0.1 shows also that P is a complete intersection the 
decomposition $=J®H when combined with Proposition 5, 878, in FAC 
[15], gives, in the notation of FAC, all the sheaf cohomology groups 
Hi(P,6(m)) where P is the projective variety defined by P. 

Another application of the primeness of J*S in algebraic geometry is 


THEOREM 0.3. The intersection multiplicity of P, at the origin, with 
any Cartan subalgebra ts w, where w is the order of the Weyl group. 
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Next, Proposition 0.2 is put into effect for all orbits of maximal dimen- 
sion by 


THEOREM 0.4, The set r coincides with the set of all quasi-regular 
elements in g. (Thus H and 8(0,) are isomorphic as G-modules for any 
ser.) 


As a consequence of Theorems 0.2 and 0.4 one shows that not only is 
the ideal J*$ prime in $ but J,S is prime for any prime ideal JGJ. 
Furthermore one gets the following characterization of all the invariant prime 
ideals in S which are generated by elements of J. 


THEOREM 0.5. Let ICS be any G-invariant prime ideal. Let uCg 
be the affine variety of zeros of I. Then I is of the form I=J,8, for Jı a 
prime ideal in J, if and only tf uNr is not empty. 

Since R(0,) = 8(O,) in case Os is closed and since Os is closed if x is 
regular one gets the G-module structure of H by applying Theorem 0.4 and 
(0.1.5) for 2 regular. Thus if D denotes the set of dominant integral forms 
corresponding to a Cartan subgroup A, so that D indexes all the irreducible 
representations of G as highest weights, then one has 


(0.1.6) mult » in H—h 


where h = dim V)4 is the multiplicity of the zero weight of n. 

In order to determine the G-module structure of S*, the space of homo- 
geneous polynomials on g of degree k, one must know more than (0.1.6). In 
fact using the relation S—J®H what one wants is the multiplicity of „A 
in Hi—SiNH for any X and j. As it turns out, for this, one needs 
R(0.) =8(0.) where e is a principal nilpotent element. To show the latter 
using Proposition 0.3 it is enough to show that P is a normal variety and 
P—O, has a codimension of at least 2 in P. 

Let ©, be the set of all orbits of maximal dimension (n—1). The set 
6, may be parametrized by €* in the following way. Let 


u: gc 


be the morphism given by putting u(x) = (u (2), > +,u:(z)) for any sE g. 
Since u reduces to a constant on any orbit it induces a map 


m: >C. 


It is known that u induces a bijection from the set of all orbits consisting 
of semi-simple elements onto C! (for completeness a proof of this fact will be - 
given here). Combining this with Proposition 0.4 one obtains 
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THEOREM 0.6. y; is a bijection. 


Thus to each £€ C! there exists a unique orbit, O? (é), of dimension n —} 
which correspond to £ under y,. Now let P (é) = u> (£) for any € C* so that 


=, U, P(E) 


is a disjoint union. Note that an =P and O*(é) =O, if & is the origin 
of C}. One proves 


THEOoREM 0.7. For any £C C! one has 
P(E) = O7 (é) 


so that P(E) is a variety of dimension n—1l. Moreover P(£) is a complete 
intersection and O*(£) coincides with the set of non-singular points on P(£). 
Finally P(E) is a finite union of orbits so that Ö, ts a finite union of orbits 
for any zeg. 


Since P(é) is a complete intersection and since its singular locus is the 
complement (a finite union of orbits) of O*(€) in P(é) one would get the 
normality of P(é) by a theorem of Seidenberg if one knew the dimension of 
the other orbits in P(£) were at most n—1—2. 

Now it is well known that dim O, is even (and hence dim, Os is a multiple 
of 4) for any semi-simple element zeg. Less known is the following 
proposition observed independently by the author, Borel, and (most aay 
proved by) Kirillov. 


Proposition 0.5. The dimension of Os is even for any ze q. 
Combining Theorem 0.7 and Proposition 0.5 one obtains 


THeonsm 0.8. Let E€ C? be arbitrary. Then P(£) is a normal variety 
and the codimension of P(é) —O*(£) in P(E) is at least 2. 


Applying Proposition 0.3 one then has 


Texeorem 0.9. Letzer. Then R(O,)—=S(0.). (This implies that 
all R(O,) for zEr are isomorphic as G-modules; even though they are not 
in general as rings.) Let&=u(z). Then R(Os) (= R(G/G*)) is an affine 
algebra (even though Oa is not necessarily an affine variety) and P(E) is the 
variety of all maavmal ideals of R(O,). Thus the embedding of G/G* in g 
as Og is special in that any morphism of G/G* (or Oe) into any affine variety 

‘extends uniquely to a morphism of P(£) — Ö, into the variety. (In particular 
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this holds for O, and Ö,=P.) Finally (using (0.1.5) and the equality 
R(0,)=8(0.)) one has, for any AED 


(0.1.7) dim =h 
so that the left side of (0.1.7) is independent of zer. 


Now let {e.,2,¢} be a principal S-triple (that is, a “canonical” basis 
of a principal three dimensional simple Lie subalgebra). In particular then 
e is a principal nilpotent element. Used heavily in the theorems above is the 
result of 03] which asserts that 8° is l-dimensional and has a basis z, 
i= 1,2,: > -,4, such that 


(0.1.8) -o [2o u] = mg 


where, we recall, the m, are the exponents of g. The main application of 
this is the following result: Let a be any subspace of g such that (1) 
g=—a-+[e,g] is a direct sum and (2) a is stable under ada (e.g. take 
a==g*). Then if b is the /-plane defined by the translation bp ==: e.+-a one 
has . 
Taxorem 0.10. The variety b ts contained in rt. Moreover each orbit 
in O, intersects b in.one and only one point. Finally the mapping f— f |v 
induces an isomorphism of J onto R(b). . 


Remark. If g is the set of all 1 X complex matrices then one shows 
easily that r is the set of all matrices whose characteristic polynomial is equal 
to their minimal polynomial. An example of the subvariety b is the set of 
all “companion” matrices. Here the validity of Theorem 0.10 is a well- 
known fact in matrix theory. 

Now since g° == g@° (because g° is commutative) and since (0.1.7) holds 
for z= 6 this suggests a generalization of the notion of exponent. Let V be 
any finite dimensional G-module with respect to a representation v. If I is 
the multiplicity of the zero weight of v then by (0.1.7) one has dim VO ==}. 
It follows therefore that there exists a unique non-decreasing sequence of 
non-negative integers m4(v), +—=1,2,- - -,, such that one has 


v (Lo) = m,(v)% 


for a basis % of V°. If yv is the adjoint representation the m,(v) are the- 
usual exponents. If »—=» we will write m,(A) for m() and note (because: - 
the highest weight has multiplicity one) that 


m,(A) =0(A) for j= 
where o(A) is the sum of the coefficients of A relative to the simple roots and! 
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that this highest value occurs with multiplicity one among the generalized 
exponents 7%(A). (This specializes to the familiar relation mı—=o(y) when 
g is simple and y is the highest root.). 

The following theorem now gives the G-module structure of H? and 
hence S* for any j and k. 


THEOREM 0.11. Let AED be arbitrary and let H(A) be the set of G- 
harmonic polynomials which transform under G according to >. Let (by 


l ‘ 
(0.1.6)) H(A) =S Aà) be a decomposition into irreducible components 
=1 
so that H;(A) GH™ where nj, j=1,2,- + +,h, is a non-decreasing sequence 
of integers. Then n„—m;(A) for all j. In particular then k—o(X) is the 
highest degree k such that v occurs in H*. Moreover it occurs with multi- 
plictty one for this value of k. 


Assume for convenience that g is simple and let y€ D be the highest 
root. Let a,+—1,2,-- +,” bea basis of g. If the u,€ J are chosen properly 


one sees that a, i= 1,2,: ,n,is a basis of H;(y). One notes then that 


Theorem 0.11 is a generalization of the result in [13] given by (0.1.8). 

H. S. M. Coxeter observed and A. J. Coleman proved in [4] that if W is the 
Weyl group and «€ W is the Coxeter-Killing transformation then the eigen- 
values of ø operating on the Cartan subalgebra are ertmils, 7=1,2,-- -,], 
where s is order of o. Now more generally W operates on the zero weight 
space of Vò for any A€ D according (say) to some representation m> of W. 
As a generalization of the Coxeter-Coleman theorem one now has 


THEOREM 0.12. For any AED the eigenvalues of lc) are erty Ala, 
j==1,2,°--,h. l 


0.2. By applying the Birkhoff-Witt theorem the results above carry 
over from § to U, the universal enveloping of g (U is obviously a G-module 
in a natural way). 


THEOREM 0.13. Let U be the universal enveloping algebra over g and 
let ZCU be the center of U. Then U is free as a Z-module (under multi- 
plication). In fact 
(0.2.1) Ux LOH 


where E is the subspace (and G-submodule) of U spanned by all powers a* 
for all nilpotent elements x€ g. Moreover E ts equivalent to H as a G-module 
so that every irreducible representation of G occurs with finite multiplicity 
in E (in fact Y occurs I, times in E for any X€ D). 


LIB GROUP REPRESENTATIONS. 335 


Let V be a finite dimensional irreducible U-module so that one has a G- 
module algebra epimorphism 
p: U> End V 


Since p(Z) reduce to the scalars it follows from (0.2.1) that p(#) = End F. 
Now let Y be any subspace of U. If Y is one-dimensional then it is due to 
Harish-Chandra that there exists an irreducible U-module V such that p is 
faithful on Y. ‘This is not true in general if dim Y= 2. However it is true 
EYCE. 


THEOREM 0.14. Lei YC E be any finite dimensional subspace. Then 
there exists an irreducible U-module V such that p is faithful on Y. 


I would like to express my thanks to C. Chevalley, M. Rosenlicht and 
A. Seidenberg for helpful conversations about questions in algebraic geometry. 
In particular to Siedenberg for making me aware of his criterion for normality 
and to Chevalley for simplifying my proof of the primeness of J*S. 


1. Consequences of the primeness of J*S and a dense orbit in P. 
1. Let X be a n-dimensional vector space over the complex numbers C. Let 
S,—=8,(X) symmetric algebra over X. One knows that S, may be regarded 
as the algebra of all differential operators @ on X which may be put in the 


form 
é h ö in 
al) (a) 


where the di- are complex constants and 2,,° - *, Zn are the affine coordinates 
of X. 

Let S* == 8*(X) (or just S) be the symmetric algebra over the dual 
space to X. Then g is just the ring of all polynomials on X. In fact we 
take the point of view that X is an afline variety (over C) and is its ring 
of everywhere defined rational functions. The algebra S (resp. 94) is graded 
in the obvious way and a subspace LC S (resp. LC Sa) will be called graded 
if it is spanned by its homogeneous components LI = LN 8i (resp. LN 8). 

Now one knows that a non-singular pairing of 9, and S into C is 
established by putting 


(1.1.1) <ô, f> — 8f (0) 


where de Sy, f E S and ôf (0) denotes the value of the function ĝf at the origin. 
In this way S+ is orthogonal to 85 if j>£% and becomes isomorphic to its dual 
if ke=j. It is obvious from (1.1.1) that 


(1.1.2) <a, f> = (82, O:f> 
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for any ôs, ðs € Sẹ and f E€ S and hence in particular if fe S™ and ze X then 
by the Taylor expansion 
da 
(1.1.3) Te) 


Same? 





where 9, is the element of 8,(X) =X corresponding to 2. 


‘Now assume that GC AutX is a connected linear reductive algebraic 
group, i.e, @ is the complexification of a connected compact subgroup of - 
Aut X. We regard G as not only operating on X, but by unique extension, as a 
group of algebra automorphisms of 8,(X) and also as a group of algebra l 
automorphisms of S(X). The action on the latter is also uniquely defined 
by requiring that | 


(1.1.4) <a: 0,a°f>=<6,f> 
for all a€ G, 0€ Sy and féS. Note by (1.1.3) that 
(1.1.5) (af) (z) =f (a*s) 


for any z€ X, fE S and a€ G. 
Now let JCS be the graded subring of G-invariant polynomials in 8. 


That is 
J={feS|a-f—f for all a€ G}, 


and let 
J+—= {fe J | f(0) = 0}. 
We will often be concerned with the homogeneous ideal J*8 in 8 generated 
by J*. 
PROPOSITION 1. Let L be any graded subspace of S such that 
SaJS'*S+L is a direct sum. Then 
SJL. 


Proof. We must show S*C JL for all k. This is obvious if k—0 since 
8°CL. Assume it is true for Si where j=. But since one clearly has. 


t 
ge C JSH + L where $® — > 8+ it is then obviously true for 6t, Q. E. D.. 
40 


We are interested first of all in the question as to when S is free over J, 
or more specifically, as to when S is a tensor product of J and L. (Choosing 
L to be G-stable, such a decomposition of 8 reduces the study of its G-module- 
structure to that of L.) We first observe that the two conditions are equivalent. 

The expression linear independence (resp. basis) without any reference- 
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to a ring always means linear independence (resp. basis) with respect to C. 
Furthermore, tensor product without reference to a ring means tensor product 
over C. 


Lemma 1. The following conditions are equivalent: 


1. Let L be as in Proposition 1. Then the map 
- JOL >g 
given by fS g— fg is an isomorphism. 
2. Bis free over J. , 


3. Let MCS be any subspace such that M N J*8 = (0). Then for 
_ elements in M linear independence is equivalent to linear independence over J. 


Proof. Obviously (1) => (2) since a C basis of L defines a J basis of 8. 
Assume (2) and let e, ¢==-1,2,---, define a J basis of S. Let fi,-- +, fe 
_ be linearly independent elements of M. For j=1,: > -,k write y— > aye, 
where we may assume t+==1,2,---,p and aj€J. To show that. the fi are 
linearly independent over J it clearly suffices to see that the k X p matrix (ay) 
with entries in J is of rank k. If f denotes the image of f € 8 in 8/J*8 it is 
clear that f,— Yay(0)e/,. Since the fy are obviously linearly independent 
it is clear that the C matrix a,(0) is of rank k. Hence not‘all Æ X k minors 
of the J matrix (ay) can be zero. This proves that the f; are linearly inde- 
pendent over J. 

It is trivial that linear independence over J implies linear independence. 

To obtain (1) from (3) we simply put M =L and apply Proposition 1. 

l Q. E. D. 

1.2. Now for any z€ X let 


Oa = {y € X | y = az, for some a € G}. 


A subset O CX is said to be an orbit if O—O, for some zEX. 
For any z € X let 
Ge— {0 E€ G | az = z} 


It is clear that G* is an algebraic (hence a closed, complex Lie subgroup) 
subgroup of G. Furthermore if 


(1.2.1) - Pe GX 
is the map given by f’.(a) = az then A’, induces a bijection 
(1.2.2) Be: G/G*> 0, 
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Now let U be universal enveloping algebra of the Lie algebra of @. 
Then since the representation of G on S induces a representation of its Lie 
algebra on S it is clear that $ becomes a U-module by further extension to U. 
Obviously S* is a U-submodule for any k. We denote by p- fE the effect 
of applying p to f where p€ U and fe S. 

For any subset PC X and f¢8 let f | P be the restriction of f to P. 


Lemma 2. Let fE 8, j=1,2,: > -,k, and let p, t—1,2,---, bea 
basis of U. Consider the k-column matris D— (dy) where dy = p; f} (The 
matric thus has entries in S and hence, for any xE X, D(x) = (dy(x)) is a 
C matriz.) 


Then if sE X the functions fı | Oa on Os, j =1,2,: : ',k, are linearly 
independent if and only if D(x) has rank k. 


Proof. Let C be the algebra of all holomorphic functions on the complex 
homogeneous space G/G*. It is clear that C is a module for the Lie algebra 
of G since the latter defines holomorphic vector fields on G/G*. Hence C also 
becomes a U-module and in such a way that if 


a: S>C 
is the homomorphism given by af==fof, one has 
(1.2.3) alp: f) =p: af 


for any f€ 8. Furthermore if se G/G* denotes the point corresponding to 
G- and g€ C then since the Lie algebra of G spans the holomorphic tangent 
space at s it follows from the Taylor expansion that g vanishes identically on 
G/G@ if and only if (p- g) (s) =0 for all pe U. 

Now assume that rank D(z) <k. Then there exists a non-zero vector 
(c, + °, Cx) € C* such that È Byly for all i. Thus if P= 268 


one has (p- f) (z) —0 for all p€ U. Thus by (1.2.3) (p< af)(s) =0 for 
all p€ U and hence af vanishes identically on G/G*; or equivalently f | Oa 
is zero. Hence the f;| O, are linearly dependent. Conversely assume that 
the f; | Os are linearly dependent so that (> cf;)| Os is zero for a non-zero 
vector (¢,° * >, C+) € C*. But then «(2 cf) = 0 and hence for i= 1,2, > +, 


= opi ` filz) = (m° «2 cafi) ) (8) 
— 0 
Q. E. D. 
Thus rank D(z) <k. 
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As a corollary we obtain the following criterion for linear independence 
over d. i 


Lemma 3. Let f;€ S,i—1,2,:--,k. Assume the functions f;| O are 
linearly independent for some orbit OC. X. Then the f; are linearly inde- 
pendent over J. 


Proof. Assume $, 9;f;—=0 where g;€ J, jum 1,2," -+,k. Let D be the 
i 


matrix given in Lemma 2 and let ve O. Then by Lemma 2 there exists a 
kX k minor of D whose determinant a€ § is such that a(x) 40. But then 
there exists a neighborhood W of z such that a (y) 0 for all y€ W. Thus 
D(y) has rank & and hence the f; | O, are linearly independent for all y € W. 
But since the g; reduce to constants on any orbit O, it follows from the relation 
2 gf 0 that the g; vanish identically on W. ‘This implies that the g; 


vanish on X since the g; are polynomials. Q. E. D. 
1.3. For any subset Y C X we will let 
I(Y) = {fes| f| ¥=0} 


be the ideal in 8 defined by Y. 
Now let P CX be the cone (since J* is homogeneous) given by 


P= {ze X | f(x) —=0 for all fe J*} 


Since P is defined by the ideal J+S one knows that I(P) is the radical 
of J*S and that the cone P is irreducible (in the sense of algebraic geometry) 
and J*S == I (P) if and only if J+S is prime. 

We now give a criterion for the conditions of Lemma 1 to be satisfied. 


ProposiTion 2. Assume (1) J*S is prime and (2) there exists an orbit 
O such that Ö=P. Then the conditions of Lemma 1, §1.1, are satisfied. 
In particular tf S==JI*S4-L is a direct sum where L is a graded subspace 
of S then the map 


(1.3.1) J8L>8 
given by f@g— fg, is an isomorphism. 


Proof. Let MCS be any subspace such that MNJ*S=— (0). Since 
J*S =I (P) it is clear that if f,€ M, j7—=1,2,- - +, k, are linearly independent 
then the f; | P are linearly independent. But this obviously implies that the 
f; | O are linearly independent since Ö=P. But then the f; are linearly 
independent over J by Lemma 3 and thus the result follows by (1) and (3) 
of Lemma 1. — Q. E. D. 
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Remark 1. In the proof we have only used the fact that J*S —I(P) 
and not that J+S is prime. However assumption (2) already implies that 
the cone P is irreducible (recall that G is connected) so that there is no loss 
in assuming that J*+S is prime. 

1.4. Now assume that B is a symmetric non-singular G-invariant bilinear 
form on X. Then, as one knows, B induces a unique G-module ring isomor- 
phism (also written B) 

(1.4.1) B:8,>5 


of degree zero where <s, Bd,» =B(z,y) for any z,y€ X. Obviously for any 
0,,0,€ Sy one has 
(1. 4. 2) <d,, Bas» = <82, Ba. 


Now let 
Jy = {0 E€ Sa | a+ 0—0 for all a€ G} 


and let J,* be the space of elements in J, having zero constant term. It is 
obvious that 
B(J,)=J and B(J,*) = Jt. 


An element f € § is called G-harmonic in case 
of =0 


for all d€ J,*. Let H be the (obviously graded) space of all G-harmonic 
polynomials in 9. By (1.1.2) and (1.1.4) it is clear that H is a G-sub- 
module of 9. 

One obtains a class of G-harmonic polynomials in the following way: 
Let P’ be the cone in S* defined by putting 


P’ = B{d,€ Sı | TEP} 


and let Hp C S be the (graded) space spanned by all powers z™, m—=0,1,---, 
for all z€ P’. The following proposition was proved independently by 
Helgason (see [10]). 


PROPOSITION 3. One has HpCH. Furthermore S=J+*S-+H is a 
G-module direct sum so that by Proposition 1, 81.1, 


S=—JH. 


Proof. Let z€ P” so that z= B(@,) for se P. Let d€ J, where k>0. 
We wish to show that ôz™—= 0. We may assume that m= k and hence by 
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(1.1.2) it suffices to show that <ô, z" —0 for all 1€ Smr But by 
(1.4.2) ° 
l £604, 2") = <ô, B (dar) > 
— <z”, B (68,) > 
0, > 


where f—=Bö and f,—Bé, But feJ* and hence fi—geJ*d. Thus 
£60, 2") = (dr, gy == mig (x) = 0 since s€ PandgeI(P). Hence He CH. 
Now let H’ C 8 be the orthocomplement of J,*S, in 8. Thus if fed 
then f€ H’ if and only if 
< 861, F> = <b, Of> 
— (0 


_ for all 6,€ 8 and de Jy*. It follows immediately then that H’=-H. To 
prove that S—J+*S +H is a direct sum therefore it suffices, by dimension, 
(one restricts to S*) to show that HNJ+*8—0. (One already uses that 
B(J4*8,) =J*8). But to show HNJ*S=0 it suffices to show that B 
induces a non-singular bilinear form on Jy*S%y. Now let K be a maximal 
compact subgroup of G. Then one knows there exists a real subspace Xg CX 
such that (1) X% is stable under K, (2) B is positive definite on Xg and 
(3) X=Xp+iXy is a real direct sum. But by (2) it is obvious that B 
induces a positive definite bilinear form on Sy,n(Xr) =Sr. But by (1) and 
(3) J,* is the complexification of its intersection with Sp since @ is the 
complexification of K. Hence J,*S, is also the complexification of its inter- 
section with 9% and consequently B induces a non-singular bilinear form on 
I'S. Q. E. D. 

Now combining Propositions 2, 81.3, and 3, 81.4, we obtain the fol- 
lowing “separation of variables” theorem. 


PROPOSITION 4. Assume that G leaves invariant a symmetric non- 
singular bilinear form on X. 

Let 8, H and J be, respectively, the ring of all polynomials on X, the 
space of G-harmonte polynomials on X and the ring of invariant polynomials 
on X. 

Let POX he the homogeneous affine variety defined by the ideal J*S 
in S. 

Now assume (1) that there exists an orbit O such that O =P and (2) 
the ideal JS is prime. Then the mapping 


(1.4.8) J®H>8 
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gwen by F®g>fg is a G-module isomorphism. Furthermore tf PPC S! 
is the cone corresponding (by means of the bilinear form) to P and Hp is 
the subspace of 8 generated by all powers z”, z € PY, m =0,1,: - +, then 


(1.4.4) H=Hp. 


Proof. Since @ operates as algebra automorphisms of $ it is obvious 
that (1.4.3) is a @-module map. But it is also an isomorphism by Proposi- 
tions 2 and 3. Now let H4 CS, be the space generated by all powers 0,” 
where v€ P. Let B be as in (1.4.1). Then clearly B(H,) = Hp. . Now 
if Hp” H" then by dimension and Proposition 3 there exist a non-zero 
fe H™ such that <8, f> = 0 for all de Hm. But then putting ô= ĝs”/m! for 
ze P it follows from (1.1.3) that f(z) =0 for all ve P. But then fe J*8 
since J*S is prime. This is a contradiction since J+8 N H — (0). Q.E.D. 


. Remark 2. A familiar instance as to when the conclusion of Proposition 
4 holds is the case where X = C”, n= 2, and G is the full complex rotation 
group. Here J is the algebra generated by 1 and 213+- - -+ 2,%, H is space 
of all polynomials which satisfy Laplace’s equation. 


ia! 


and P is the conic given by 2?+ - -+2 =0. If nÆ=3 one obtains the 
classical separation of variables theorem as a consequence of Proposition 4 
since (1) P=Ö, where O is the set (easily seen to be an orbit) of all vectors 
xE C” such that ze P and 20, and (2) J*S is a prime ideal, because it is 
generated by 2? +- +--+ 2,? and this polynomial is irreducible if n= 3. 


1.5. For any element z€ X besides Os, we may consider the orbit Oss 
where c€ C* is any non-zero scalar. It is obvious of course that Oce = COs. 
Now where PCY is the cone defined in §1.3 and s€ X is arbitrary put 


Pa= (On NP 
oec* 


It is clear of course that Pa C P is stable under the action of G. An element 
TEX will be called quasi-regular if 
P,=P 


Remark 8. Note that if P=Ö for an orbit O then any element of O 
is quasi-regular. 

Now for any subset W C X let $(W) be the ring of all functions on W 
of the form g | W where g€ 8. Note that if W is stable under @ then 8(W) 
is a G-module with respect to the action of G given by (1.1.5) where f € S(W). 
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Let zE X. We are particularly interested in the ring S(O.) of functions 
on the orbit Os. 


Obviously the map ` 
(1.5.1) S— 8(0z) 


defined by the correspondence f—> f | Os is a G-module epimorphism. 


Proposition 5. As in Proposition 1, §1.1, let LCS be any graded 
subspace such that S=J*8 +L is a direct sum. Also for any se X let 


Ye: L>8(0,) 


be the linear map obtained by restricting (1.5.1) to L. Then ye is an 
epimorphism. 

Assume that conditions (1) and (2) of Proposition 2, § 1.3, are satisfied. 
Then ye is an isomorphism for any quasi-regular element sE X. 

In particular if G leaves invariant a non-singular symmetric bilinear form 
on X and, as in Proposition 4, 81.4, L= H is the space of G-harmonic poly- 
nomials on X then 


(1.5.2) y»:H>8(0,) 
is a G-module isomorphism for any quasi-regular element ze X. 


Proof. Since J reduces to scalars on any orbit O, it follows from Proposi- 
tion 1 that ys maps L surjectively onto 8(O,). Assume now that conditions 
(1) and (2) of Proposition 2 are satisfied. Let 2 be quasi-regular. We must 
show that ys is injective. Let fe L. Since L is graded we may write 


% 
f= > af, where f,€ L is homogeneous of degree n, and the fy t= 1,2,---,k, 
4-1 


are linearly independent. 


But now since J*§ is the prime ideal corresponding to P it follows that 
the functions f, | P are linearly independent. But since P—Ö for an orbit O 
one has also that the functions f; | O are linearly independent. The argument 
of Lemma 2, § 1.2, shows that for any y€ O there exists a neighborhood W 
of y in X such that for any z € W the functions f; | Os are linearly independent. 
But now since y € P =P, there exists a non-zero scalar c such that Oos = Os 
for some z€ W. Hence there exists a non-zero scalar c such that the func- 
tions fs | Oc» are linearly independent. Now let 


Be Os Oz 
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be the bijection defined by y>1/c-y. If »* is then the corresponding con- 
travariant isomorphism on functions one has 


p* (fr | Ow) = 1/0" (fs | Oo) 


But then since the fi | Oos or 1/c":(f} | Oow) are linearly independent it follows 
that the f; | Os are linearly independent. But then if f | Os is zero it follows 
that the cq are all zero and hence f is identically zero. Thus ye is injective. 
The isomorphism (1.5.2) is a G-module map since (1.5.1) is a G- 
module map. . Q. E. D. 


Remark 4. In the example of Remark 2, 81.4, not that ve C* is 
quasi-regular if and only if z +40. 
Thus in that example one has that 


(1.5.3) yo: H> S(Oz) 


is an isomorphism for any s40. Hence all S(O,) where z>£0 are equiv- 
alent as G-modules. 


1.6. In order to apply Propositions 8, 4 in § 1. 4 or Proposition 5, § 1.5, 
one needs to know that J*8 is a prime ideal. In general this appears to be 
difficult to ascertain even if one knows J completely. (Except of course if J 
has only one ring generator, as in the example of Remark 2.) However we 
will now observe (Proposition 6, §1.6) that in the familiar case when J is a 
polynomial ring the question of the primeness of J*S reduces to a more 
manageable one. 

Throughout much of the remainder of the paper we will need to draw 
upon techniques and results in algebraic geometry. Our reference for all 
definitions will be [3] where for us the fixed algebraically closed field is of 
course C. We recall in particular that by definition, among other things, 
a variety is irreducible in its Zariski topology. 

To avoid confusion of terminology we remark here. that the words open, 
closed, closure and denseness, etc. will have their usual Hausdorff topological 
meaning unless stated otherwise (i.e., unless preceded by “ Zariski”). 

If AES, += 1,2,- - -,1, are arbitrary let (fa - -,f;) denote the ideal 
in 9 that they generate. If Y'C X is a Zariski closed subvariety of X of 
- dimension n —/ then we recall that F is called a complete intersection in case 


IF) = (fu + sft) 


for some KEI(T),i-1,;: - -,1. 
Now for any fe § and ze X let (df), be the value of the differential df 
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at s. If AES, il, ',l, then one knows that the (df,), are linearly 
independent if and only if the nX? matrix (62,f:) (2), j=1,' > ',n, has 
rank / where the z; is any basis of X. 

The following lemma in one form or another is well known in algebraic 
geometry. 


Lemma 4, Let f,€ 8, +-—=1,2,---,1, and let Y be. the Zariski closed 
set given by T ; 
Y—{seX | A(z) = 0,1 =1,: - +, T}. 


Assume (1) Yisa subvariety of X (that is, assume Y is irreducible) and 
(2) there exists y€ Y such that (dfi)y, t=1,2,: - -,1, are linearly indepen- 
dent. Then Y is a subvariety of dimn—l. Furthermore 


(1.6.1) I(Y) = (fot + + ft) 
so that (a) (fu: ` *,f:) is a prime ideal and (b) Y is a complete intersection. 


Proof. Let 8, be the local ring of X at y. Let I= (fi,-- '‚fi). Since 
the (df;), are linearly independent the fi may be included in a complete 
system of uniformizing variables at y. Thus by [3], Proposition 3, p. 219, 
IS, is a prime ideal of Sy. Furthermore since I(Y) is the radical of I in 8 
it is clear that IS, is the ideal of Y at y (that is, J(Y)S,—JISy,) so that, 
by the same reference, dim Y = n — 1} and I8, N 8 —I(Y). To prove (1.6.1) 
it suffices to show that I is primary for I(Y) since in that case I9, N S =I 
(a primary ideal is equal to the contraction of its extension ; see [13], Theorem 
19, p. 228). But I is primary by MacCaulay’s theorem (see [19], p. 203) 
which asserts that there are no embedded primes for I so that I(Y) is the 
only associated prime ideal. Q. E. D. 

Now we recall that G is a connected algebraic reductive group. Hence 
G has the structure of an affine variety. (It is Zariski closed in Aut X but 
not necessarily Zariski closed in End 2X.) Since (1.2.1) is obviously a 
morphism it follows that any orbit O C X is an irreducible constructible set. 
In fact since O is epais ([3], Proposition 4, p. 95) and Œ operates transitively 
on it, it follows that O is a subvariety ([3], Theorem 5, p. 68) of X: NE 
follows therefore that its (usual) closure Ö is a Zariski closed subvarigty of 
the same dimension as O. 


As an application of Lemma 4, 81.6, we have 





Proposition 6. Assume J, as a ring, is ae by I homogeneous 
algebratcally independent polynomials u, t= 1,2,-- -,1. 
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Now let € Ct, é= (&,- + -,&1), be an arbitrary complex I-tuple and let 
| P(é) = {2€ X | u(t) il) | 
Assume P(£) is not empty and there exists an orbit O(£) such that 


(1.6.2) P(t) =O(8). 


Then P(E) is a Zariski closed subvariety (of X) of dimension n—l. 
Furthermore the ideal (t,—&,- + `, ur — £) in S is prime if and only if 
there exists y € P(£) such that the (ds), are linearly independent. In such 
a case P(£) is a complete intersection and the set P(E), of simple points on 
P(E) is given by 
P(E)s= {2 € P(E) | (du) t— 1, 2,- art 

are linearly independent}. 


Proof. Since O(£) is irreducible it follows from (1.6.2) that P(€) is 
'a subvariety of the same dimension as O(¢). Now by [3], Corollary, p. 102, 
it is clear that 


(1.6.3) 


dim P (£) =n—l. 
To prove that dim P (£) —n—1 it suffices to show that 
(1.6.4) dimOsn—l 


for any orbit O. 

Let m be the maximum of the dimensions of all orbits. Let u CEndX 
be the Lie algebra of G and for each ze X let da be the homomorphism of u 
into X given by $,(2)=2(2). It is then obvious that rank ġa = dim Og. 
By consideration of minors it is then clear that 


U = {xe X | dim0,—m} 


is a non-empty Zariski open subset of X. Now let V be the Zariski open 
subset of X consisting of all ze X such that the (dus), are linearly indepen- 
dent. To see that VNU is not empty it clearly suffices to see that V is not 
empty. But this is a known consequence of algebraic independence. Indeed 
if u€ 9, j=l +1, - -,n, are chosen so that ty, t= 1,2,: -+ n, is a trans- 
cendental basis of 8 then each element of a coordinate basis 2, j= 1,2,:--,n 
of X is algebraically dependent upon the w. Hence on a non-empty Zariski 
open set each dz; is in the span of the dw. This proves that V and hence 
VU is not empty. Now let ze V NU and let W be the n — l dimensional 
variety (see [8], Proposition 3, p. 219) containing z whose prime ideal at x 
is 18, where I = (u, — u (z), - »W—u(z)) and 8, is the local ring at z. 
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Since, obviously, Os C W and dim Os = m it follows that m Sn — I and this 
proves (1.6.4) and hence dim P (£) =—= n — 1. . 

Now if the ideal (w,—&,- - *,uı— é) is prime it must equal I(P(é)) 
and hence (df), for any ze P(é) and fEI(P(¢)) lies in the span of the 
(d(u;— &) )o = (dw)s. But since dim P (£) =— n — 1} one immediately obtains 
(1.6.8) by Zariski’s criterion and since: (P(é)), is not empty there exists 
y€P(£) such that the (dw), are linearly independent. Conversely if the 
latter holds (u,—&,° - -,u:—&) is prime by Lemma 4, §1.6, and hence 
P(£) is a complete intersection. Q. E.D. 


For us Proposition 4, § 1.4, will be put into effect by 


PROPOSITION 7. Assume J, as a ring, is generated by 1 algebraically 
independent homogeneous polynomials uz, i—1,2,---,1. 
Assume also that there exists an orbit O such that P=Ö. Then Pisa 


subvartety of dimension n—l. Moreover J+S ts prime if and only if there 
exists yE P such that (du), +—=1,2,- - -,1, are linearly independent. 


Proof. This is just the special case == 0 of Proposition 6. Q. E.D. 


2. Normality and the closure of an orbit. 1. If F is any variety 
we let R(Y) denote the ring of everywhere defined rational functions on F. 

Now let C be the ring of all holomorphic functions on G. If f€ C, a€ G, 
then the left (resp. right) translate a+ f (resp. f + a) of f by a is the function 
defined by putting (a-f)(b) —f(a"b) (resp. (f-a)(b)=f(ba*)). It is 
obvious that a: FEC (resp. f -a€ C) for all fe C, ae G. 

One knows that R(G) is a subring of C which in fact may be given by 
(see [9], Theorem 5.2) 

R(G) = {f € C | space spanned by all a- f, a € G, is finite dimensional} 
It is obvious that R(G) is stable under left and right translations. 

Now let D denote the set of equivaience classes of all irreducible rational 
(equivalently, holomorphic) finite dimensional representations of G. For each 
àE D choose a fixed irreducible representation. , 


»: G— Ant V* 


belonging to A. The dual space to V> will be denoted by V, and the irreducible 
representation of Œ on V, contragradient to »* will be denoted by n. 

If M is any G-module we will let M* denote the set of all vectors in M 
which transform according to the irreducible representation y>. Since G is 
assumed to be reductive one knows that if each vector in M generates a finite 


348 BERTRAM KOSTANT. 


dimensional cyclic G-module then M is in fact a direct sum of the M>. In’ 
particular regarding R(G@) as a G-module under left translation one has that . 


B(G) — X RM) 


is a direct sum. Since ~A(G) generates End V* one can be very explicit 
about the structure of RA(@). In fact let d, be the dimension of Vy and let 
v, and vj, t,j—=1,2,: © -, da, be, respectively, a basis of V* and a basis of its - 
dual space Vy. Now let gò be the function on @ defined by 


(2.1.1) g (b) = <r, (8) 0’. 
Then one knows that the d,? functions defined in this way form a basis of 
R(Q). In particular RA(@) is finite dimensional and in fact 

dim BMG) = dè. 

Now assume that F C G is an algebraic (and hence closed, Lie) subgroup. 
Then one knows that G/F (space of left coset aF,a € G) has the structure of 
an irreducible algebraic variety where 

dim G/F == dim G — dim F 


and the ring R(@/F) of everywhere defined rational functions on G/F may 
be identified, in the obvious way, with the set of elements in R(@) that are 
right invariant under F. 

Now for any à € D let V}? be the space of all vectors in the dual space Vy 
to V^ that are fixed under all transformations on F, of the form n (a) where 
a€ F. Put 

dhf = dim V}. 


Now it is obvious that R(@/F) is a G-submodule (by left translations) 
of R(@G). It is furthermore obvious that 
BR(G/F) CRG). 


The following is a special case of an algebraic Frobenius reciprocity theorem. 
We prove for it for completeness. 


Proposition 8. Fort=1l,: ‚dh and j=1,:- -,d)” let v, be a basis 
of V* and let w; be a basis of VyF. Also let hy; be the function on G given by 


hy (b) = <u, (0) w >. 


Then hy € BA(@/P) and in fact the dd)? functions defined in this way are 
a basis of RA(G/F). 


LIE GROUP REPRESENTATIONS. 849 


Thus 
dim 2 (G/F) = dy dy? 


so that v occurs with multiplicity dA” in R(@/F). Furthermore 
(2.1.2) R(G/F) == BR (G/F) 

€ 
is a direct sum. 


Proof. The decomposition (2.1.2) is obvious since each element of 
R(@) is an element of R(@) and hence generates a finite dimensional sub- 
space under the action (left translation) of G. 

Furthermore it is also obvious that the d,d,¥ functions hy defined in the 
proposition are in RA(G/F) and (see (2.1.1)) are linearly independent. 
To prove the proposition therefore one simply has to show that every element 
of RA(G) invariant under right translation by elements of F is in the span 
of the hy. Assume that ge R>(G) and g-a—g for all ac F. Let giò be as 
in (2.1.1) (a basis of RA(G)). Write g == $ gcu where cy€ C defines a 
matrix and hence, relative to the basis v’; a linear transformation « of V). 
It suffices only to show that Ima C P}. But the condition on g implies that 
(n(a) —1)a—0 for all a€ F. This proves Im aC Vx. Q.E.D. 


Remark 5. A case of importance for us is the case where F=A is a 
Cartan subgroup of G. Here V4 is just the zero weight subspace, corres- 
ponding to A, of Vy. To make it independent of A we will put h = dy? so 
that h == multiplicity of the zero weight of » (2.1.3). 


Remark 6. Since one knows that the multiplicity of any weight „ for 
n is equal to the multiplicity of — p for yè it follows that l is also the 
multiplicity of the zero weight of ^. 


2.2. Now we wish to apply the considerations of § 2.1 to the case where 
F=o( for any r€ X. See §1.2. By Proposition 8 any question as to the 
complete reduction of R(G/G*) as a G-module becomes a question in the finite 
dimensional representation theory of @ and how such representations restrict 
to Gs. 

Now, as we observed in 81.6, the orbit O, is a subvariety of X. Further- 
more the bijection Bs: G/G*—> Oa induced by f’s is an algebraic isomorphism. 
(this follows easily from the transitivity of @ together with [3], Corollary, 
p- 58 and Corollary 2, p. 90. (See also [1], $2.2.) Thus if R(O,) is regarded 
as a G-module, using the action of @ in Oe, it follows that 8, induces a, 
G-module and ring isomorphism 


(2.2.1) B(G/G@*) + R(0z). 


350 BERTRAM KOSTANT. 


Now we recall that S(O.) is the ring of functions on Os obtained by . - 


restricting 9 (the ring of polynomials on X) to Os. Since 8, is a morphism 
one obviously has 
8(0s) CR(0,) 


for any s€ X and in fact it is clear that S(O,) is a G-submodule of R(O,). 
Unlike k(O.) whose G-module structure is completely determined by Proposi- 
tion 8 because (2.2.1) is a G-module isomorphism, in the general case it 
seems (to us) to be quite difficult to describe how S(O.) decomposes as a 
G-module. 

In many instances, however, S (0s) = (Oz) (and hence, in such cases, 
one knows the G-module structure of S(O,)). Indeed, in the general case 
since O, is Zariski closed in X one has 


(2.2.2) S (Ör) = R(Ö,). 
Thus ; . 
(2.2.3) 3(0.) =£R(0,) if ,—Ö.. 


Remark Y. In the example of Remark 2, 81.4, one depends upon the 
equality § (0s) =R(O,) for a particular x in order to solve the Dirichlet 
problem in R”. Indeed let ze R” where (2,2) =a>0 and let f be a con- 
tinuous function on the sphere S™! == Os N R” of radius Va. The problem, 
is to extend f as a harmonic function f defined in the interior of Sr, To 

do this one expands f 


f= Boah 
AEeD 


using some limiting process (e.g., Ls), as an infinite sum of spherical har- 
monics fa. That is, here ca € C and fa = g, | S*-* where 


gr E B05) 


However since R(0,)— S (Oe) it follows from (1. 5.3) that there exists a 
unique harmonic polynomial hà € H on Cr such that hy | Os = gù. One then 
puts 
f= È oh’y 
AeD 


where h’ is the restriction of hy to the interior of Ir, 

Now it is not necessarily true, in general, that 3(0,) —FR(O,). For 
example let X be the m? dimensional space of all complex m X m matrices and 
G is the general linear group Gl(m,C) regarded as operating on X by left 
matrix multiplication. Then if x is the identity matrix O, is isomorphic to 
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md: But 8(0,) #E(0,) since in particular if f(a) = (deta)~+* for 
zE G then FER(O,) but fé 8(0,.). 

' The equality 8(0,) = (Oz) in the example of Remark 7 when (2,2) > 0 
may be established either using the fact that O, is closed (see (2.2.3)) or by 
applying the Stone-Weierstrass theorem to both S(O,) and R(O,) restricted 
to O,R*. These methods also work more generally in case (2,2) 0. 
However, they do not apply to Os where 240 and (z,2) == 0, Nevertheless 
it is still true in this case that R(0,) —S(O,). The more powerful tool (and 
the one that will be required in § 5.1) needed to establish the equality for thig 
case is given in the next proposition. 

For any z€ X let Ca be the Zariski closed subset of X defined by taking 
the complement of O, in Os. If we put 


codim C, == dim 0, — dim Cs 


then of course one has 
codim 0, = 1. 


An affine variety Y is called normal in case the ring R(Y) is integrally 
closed in its quotient field. 


Proposttion 9. Let c€X. Assume (1) that Ö, is a normal variety 
and (2) that codim Os = 2. Then 


8(0,) =R(0.). 


Proof. If Y is any variety let Q(Y) denote the field of all rational _ 
functions on Y. In any fEQ(O,) let f denote its image.in Q(Ö,) under 
the canonical isomorphism Q (0s) —>Q(Ö.) defined by extension. 

Now let f€ R(O,). Then obviously f€ Q(Ö,) is defined at every point 
of Os. Thus if T is the set of points of O, where f is not defined then TC Os. 
Since codim C, = 2 one also must have codim T = 2. ` But now for a normal 
affine variety Y one knows (see [3], Proposition 2, p. 166 and 10, p. 134. Also 
Corollary, p. 135), that if g€ Q(Y) then either ge R(Y) or the set of points 
where g is not defined has codimension 1. Since Ö, is assumed to be normal 
it follows that the first alternative must hold for f. That is, f is everywhere 
defined on Ö,. But then f, as a function on Og, is the restriction of a poly- 
nomial on X to O,. (See (2.2.2).) But then this is certainly true of f so 
that f€ 8(0,). Q. E. D. 


Remark 8. Proposition 9 is stronger than the criterion O,—=O, for 
insuring S (0s) =R(0+). In fact if O,=Ö, (in which case we may take 
(2) to be trivially satisfied) then C, is empty and O, is non-singular. But 
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since non-singularity implies normality the conditions of Proposition 9 are 
satisfied in case O, is closed. 

The proof that Ö, is normal for the example of Remark 2 where (z, x) = 0, 
z0, and d= 3 follows from a result of Seidenberg (see § 5.1). 


8. The orbit structure for the adjoint representation. 1. Let g bea. 
complex reductive Lie algebra of dimension n. Then g is a Lie algebra direct.. 
sum 


(3.1.1) g=a+ [e8] 


where 3 is the center of g. The commutator [g,g] is, as one knows, the 
maximal semi-simple ideal in g. 

A subalgebra a C g is said to be reductive in g if the adjoint represen- 
tation of a on g is completely reducible. Such a subalgebra is necessarily 
reductive (in itself). . 

Let g”, for any x€ g, denote the centralizer of x. An element z€ g is. 
called semi-simple if adv is diagonalizable. One knows that g” is reductive- 
in g for any semi-simple element z€ g (see e.g. Theorem 7 in [11]). 

An element z€ g is called nilpotent i in case (1) ze [g,g] and (2) ada 
ig a nilpotent endomorphism. 


Remark 9. If <€aCg where a is reductive in g then z is semi-simple- 
(resp. nilpotent) with respect to a if and only if it is semi-simple (resp. nil- 
potent) with respect to g. The proof of these statements are immediate- 
consequences of the representation theory of reductive Lie algebras. 

Now one knows that the most general element z€Eg may be rey 
written 


(3.1.2) | s=y +2 


where y is semi-simple, z is nilpotent and [y, z] == 0. We will speak of y and- 
z, respectively, as the semi-simple and nilpotent components of x. See [11],. 
Theorem 6. - 


Remark 10. I£EzeaCg where a is a subalgebra reductive in g then by ` 
Remark 9 the decomposition (8.1.2) formed in g is the same as the decom-- 
position (3.1.2) formed in a. 

In particular given the decomposition (3.1.2) one should observe that. 
z is not only nilpotent in g but also in the “reductive in g” subalgebra gu. 
In particular then 


(3.1.3) z€ [or er]. 
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Conversely if y€ g is semi-simple and z is nilpotent in g” and one puts 
z= y +z then y and z are respectively the semi-simple and nilpotent com- 
ponents of z. 


3.2. We wish to apply the considerations of 881 and 2 to the case 
where Z=g and GC Autg is the adjoint group of g. Thus not only is G 
a connected algebraic reductive linear group but in fact @ is then a semi- 
simple Lie group whose Lie algebra is isomorphic to [g, g]. 

In this case we observe that the orbit Os defined by any v€ g is just the 
set of elements of g that are conjugate to a. 

If aCg is any subalgebra then under the adjoint representation a 
corresponds to a Lie subgroup A CG. Indeed A is the group generated by 
all exp ad @ where x ranges over a. In this way g° clearly corresponds to the 
identity component of the algebraic subgroup G”. 

We recall that an element ze g is semi-simple if and only if x may be 
embedded in a Cartan subalgebra (C.8.) of g. Equivalently s€ g is semi- 
simple if and only if g” contains a C.S. of g. 

The following lemma is known. We will prove it for completeness and, 
also because, as noted in Remark 11 below, the proof may be used to give 
a more general result. 


Lemma 5. Assume zE g is semt-simple. Then (1) @ ts connected and 
(2) Os is closed in g. 


Proof. We first show G° is connected. Let be G*. Then by Theorem 2, 
p. 108, in [6], one knows that b may be uniquely written 


(3.2.1) b =— a exp ad y 


where a€ @ is diagonalizable and y€ g is nilpotent and a(y) =y. Put 
4;=exptads. Then b= ciber* = (av!) expade:(y). By the uniqueness 
of the decomposition (8.2.1) it follows that a == c,ac;+ and ¢;(y) =y. Hence 
ac G* and yE g”. But then b is “connected” to a in G* by means of the 
curve aexpsady, sE R. Thus we may assume that b is diagonalizable. But 
now by Theorem 10, p. 117 in [6], if g? is the Lie subalgebra of all y such 
that b(y) =y then g? contains a C. S. Hof g and if is any C.S. in g? then 
b = expadz for some z€ b. 

But now zE g? and since adz | g? is semi-simple there exists a C.S. 5 
such that r€ H Cg’. But b == expadz for some z€ ġ. However since HC g” 
it follows that b may be joined to the identity in G* by a curve; indeed one 
uses the curve exptadz. Hence G* is connected. 
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To show that Os is closed let h be a Cartan subalgebra such that ze). 
By the Iwasawa decomposition we may write G == KMH, where K and M are 
connected Lie groups which are, respectively, compact and unipotent (an endo- 
morphism u is called unipotent if u— 1 is nilpotent; a group is called uni- 
potent if all its elements are unipotent) and H, is an abelian Lie group 
corresponding to a subalgebra of §. Since ze) it follows then that z is fixed 
under Ho. Thus Os = KMs. We have proved (unpublished) that any orbit 
of a connected unipotent Lie group is closed. Rosenlicht [14] has generalized 
this to the case of a field of arbitrary characteristic. Thus we may use the 
reference [14] to establish that Mz is a closed subset of g. But since Os is 
obtained by applying a compact group to a closed set it follows easily that 
O» is closed. 


Remark 11. Another proof that O, is closed if s is semi-simple follows 
from Theorem 4, §3.8. In fact one sees there that O, is closed if and only 
if z is semi-simple. This observation was also made in [1]. Note however 
the proof given above, that Os is closed when x is semi-simple generalizes and 
shows that the orbit of any zero weight vector for any representation of @ 
is closed. 


As a consequence of the connectivity of G” for æ semi-simple one has 


Lemma 6. Assume x€ g is semi-simple. Then g® is stable under G# 
and the restriction of G° to g? is the adjoint group of g°. 


Proof. It is trivial that g* is stable under G*. Furthermore as we have 
observed in the beginning of this section the identity component of G” corres- 
ponds to g® under the adjoint representation of g and hence its restriction to 
g7 is the adjoint group of g*. But G° is connected by Lemma 5. Q.E.D. 


3.3. Now for the case at hand $ is just the symmetric algebra S*(g) 
over the dual space to g. The well known description of the ring of invariants 
J given below is due to Chevalley. 

If / is the rank of.g then J is generated by I algebraically independent 
homogeneous polynomials. That is, there exist homogeneous elements € J, 
t—=1,---,1, such that if C[Y,,---,¥1] denotes the polynomial ring, over 
C, in | indeterminates and 


(3.3.1) CEF,- AR; 


is the homomorphism given by p(¥1,- © +, Fi) > p(t: > +, um) then (3.8.1) _ 
is an isomorphism. Moreover, if we write deg u= m; + 1 then the integers 
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3 
m called the exponents of g, are those special integers such that I] (1 + 1?=*") 
fou 
ig the Poincaré polynomial of g. 
Throughout we will assume that the w are ordered so that 
ty Sy S++ Sm 
We will refer to the t4, +<-1,2,---,2, as the primitive invariants. 
Remark 12. One knows that the primitive invariants and even the 
l-dimensional space they span is not unique. However, in § 5.4 in connection 
with G-harmonic polynomials one normalizes the space they span in a natural 


way. See Remark 26, 85.4. 
We now define a mapping 


(8.3.2) u: gC! 
by putting 
u(x) == (u (z),- A *,u(z)). 


It is obvious that u is a morphism. 
Now let © be the set of all obits O ea Since u obviously maps any 
orbit into a point it is clear that u induces a map 


2:6>C! 
Now if u C g is any subset stable under the action of G it is obvious that 
u is a union of orbits. Let 
6,~{0€6|0Cu} 
and we will let 7, be the restriction of y to 6,,. 
Let 3 be the set of all semi-simple elements in g. Obviously 8 is stable 


under @ so that we may consider the case where u = 8. 


. Now it is easy to see that » is not one-one, that is it does not separate 
all orbits. One observes, however, that not only does n separate the orbits 
in & but also that ng is a surjection. The following proposition is no doubt 
known. We prove it for completeness. 


Proposition 10. Let 8 be the set of all semi-simple elements in g. 
Then the map 


ng: 63> C! 
induced by u (see (3.3.2)) is a bijection. 
Proposition 10 permits us to parameterize Ö, by all complex l-tuples. In 


356 l BERTRAM KOSTANT. 


order to prove Proposition 10 we need some further notation and Lemma 7 
below. 

Let § be a Cartan subalgebra of g regarded as fixed once and for all. 
Let W be the Weyl group of g regarded as operating inh. Let AC 8*(Ņ) be 
the set of roots and let A, CA be a system of positive roots fixed once and 
for all. a 

An element v€ g is called regular if g* is a Cartan subalgebra. If rE 
one knows that is regular if and only if. <z, pẹ 40 for all p€ A. Now let 

uy: > CH 

be the restriction of u to b. 


Lemma Y. The map uy is proper. (That is, the inverse image of any 
compact set is EDER): 
Proof. Let r: g—> End V be a faithful completely reducible represen- 
tation of g and let m — dim V. For any positive number & let rp be a positive 
m-1 
number such that for any monic polynomial Fr -+ S.q¥+—p(Y) in the 
4=0 


indeterminate F, where € C, one has | ¢ | <k, +—0,1,- : -,m—1, implies 
|A| Sr, for any root A of p(Y). In fact, it suffices to take r == mk +1. 
Now let f €J be the invariant polynomials defined so that 


` 1 
(3.3.3) det(¥ —x(z)) “Ir + 3 fhile) E: 
_ 0 
for any z€g. Now there exist unique polynomials 
(Ya: . -, ¥2) eC. La," 2 “als t—=0,1,- ,m—], 


so that fı = pm (us: > ,u). Thus regarding OLF.: -+,¥1] as the poly- 
nomial ring on C? it follows that f 


(3. 3. 4) falz) = pi (u (2) ) 
for any z€}. 
Now let E C C! be G compact set. We wish to show that ug'(E ) is 
compact. Let 
k — sup | pi(é)|- 
tek 
$20), m-1 


It follows therefore from (3.3.4) that | fs(z)|<% for all z€ uy*(#). Hence 
if A is a root of (3.3.3) it follows that |à |< r, for any ze us1(E). 
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Now if A(x) C8%(h) is the set of weights ofr and we put 


ne 


then since ~ is faithful it is clear that |z] defines a norm on the space a 
But for any y€ A(z), A=y(z) is a root of (3.3.3). Hence || <r; for 
any s€ ug (E). That i is, uç (E) lies in the ball w | Sr, and consequently 
is compact.  Q.ED. 


Proof of Proposition 10. Let a i=1,8,° * ',], be a basis of h and let 
+= Card A. It is then a well-known result that (the generalization from the 
semi-simple to the reductive case is trivial) 


(8.8.5) det ôs; | h =c II $ 
Beh, 


where c is a non-zero scalar. See e.g. [17]. But 


(3.3.6) He) > 0 if and only if x is regular. 
€ 


Hence the Jacobian (3.3.5) of up does not vanish identically on h and conse- 
quently the Zariski closure of ug(h) equals C*. But since u, is a morphism 
üp(h) contains a Zariski open subset of its closure; that is, a Zariski open 
subset of C”. But any Zariski BE set is dense in the usual topology. Thus 
in the usual sense 


uy (b) =C 


But now let £e C? and let y;€ ġ, j= 1,2,: + -, be such that uṣ(y;) converges 
to & Since up is proper the set y; has a cluster point y. Obviously up(y) = € 
and hence uy is surjective. It follows therefore that yg is surjective since 
every element of h is semi-simple. 

To show that yg is injective we must show that if z, y € Sand u(z) =u(y) 
then x and y are conjugate. Since every element in 3 is conjugate to an 
element in } we may assume z,y€h. But now by Lemma 9.2 in [13] (the 
extension to the reductive case in trivial) if u,(z) = u(y) for j7-=1,2,-- -,1, 
then z and y are conjugate under the Weyl group and consequently are con- 
jugate with respect to G. One explicitly uses here the well known theorem 
that, under the mapping S*(g) > S*(h) induced by injection Hg, J maps 
onto the algebra of Weyl group invariants. Q. E. D. 

Since yg is a bijection we may invert it. For any ¢¢ C! we will let O’ (£) 
be the unique semi-simple orbit O such that ng(0) = £. 


3.4, We now wish to look at the orbits of maximal dimension. By 
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adding and subtracting the dimension of the center of g it is obvious from 
that for any TE g 
(3.4.1) dim O, = dim g — dim g° 

== n— dim g°. 


PROPOSITION 11. Let zeg be arbitrary. Then g? contains an | dimen- 
sional commutative subalgebra. 


Proof. This is just Theorem 5.7 in [13]. (Using the grassmannian 
of all I-planes in g the proof is an easy consequence of the fact that the set 
of regular elements is dense in g.) Q.E.D. 

As a corollary one has 


Proposition 12. Let zeg. Then 
(8.4.2) dim0,5n—1 
and the set of x for which equality holds in (3.4. 2) is not empty. 


Proof. The equality in (3.4.2) clearly holds for all regular elements 
in g. (It also holds for a larger collection of elements. See (3.4.3) and 
Theorem 2, §3.5). The inequality (3.4.2) for all elements follows from 
(3.4.1) and Proposition 11. Q. E. D. 

By Proposition 12 n—1 is the maximal dimension of any orbit. We 
now wish to consider the set of elements in g which define orbits of this 
dimension. Put . 


(3.4.3) r—{zég|dimg*—]}. 


It is obvious that r is stable under G so that we may consider the subset 
6.<6. In fact 6, is the set of orbits given by 


(3. 4. 4) 6, ={0€ 6 | dim 0 =n—]}. 


The structure of r and 6, will be known as soon as we establish certain 
facts about principal nilpotent elements (Theorem 1). We will use a different 
definition of principal nilpotent than that given in [13]. 

Let p be the set of all nilpotent elements in g. An element zeg is 
called principal nilpotent if and only if 

zepNr 


that is, if and only if (1) æ is nilpotent and (2) dimg*—l. 
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Obviously p is stable under G so that we may consider the set of orbits y. 
The following was established in [13]. 


THEOREM 1. There are only a finite number of elements in Oy. Further- 
more the set pNr of all principal nilpotent is not empty and ts in fact a 
single orbit O€ Op. That is, for any e€ pr one has (1) 


dim 0,=—=n—1 


and (2) 

(3.4.5) pnr—0. 
Moreover, this orbit is dense in p. That is, 

(3.4.6) p=0, 

for any principal nilpotent element e. 


If O€ Oy is any orbit other than the orbit of principal nilpotent elements 
one has l 


(8.4.7) dim 0 <n—l. 
Proof. Theorem 1 above is a restatement of Corollaries 5.3 and 5.5 
in [18]. Q. E. D. 


Remark 13. It follows from (3.4.6) that the set of nilpotent elements 
p Cg is an affine variety of dimension n——1. With regard to all the orbits 
in Ö, it should perhaps be recalled that in [13] it was shown that excluding 
the orbit consisting of zero alone they are in a natural one-one correspondence 
with the conjugacy classes of all 3-dimensional simple subalgebras of g. 

If z€ g is arbitrary and == y + z is the decomposition (3.1.2) then by 
the uniqueness of the decomposition, clearly, 


(3.4. 8) Ge— Gn Gs 
and hence 
(3. 4.9) g? g N g5. 


The subset r may be characterized as follows: 


Propostrion 13. Let sE g be arbitrary. Write t =y -+z where y and z 
are, respectively, the semi-simple and nilpotent components of z. 

Then zE r tf and only if z is a principal nilpotent of the reductive Lie 
algebra g”. 


Proof. Now g¥ is a reductive Lie algebra of rank 1, and z is a nilpotent 


3 
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element of g”. (Remark 10, 83.1.), Furthermore g” N g” is exactly the 
centralizer of z in g”. Thus by definition z is a principal nilpotent element 
of g” if and only if dim g” N gf ==}, But then by (8.4.9) one has zer if 
and only if z is a principal nilpotent element of g”. Q. E. D. 


3.5. Now let zeg and let z==y +z be the decomposition (3.1.2) 
for z. Then as was observed in [18] 


(3.5.1) - e) =f (y) 


for any invariant polynomial f€ J. That is, f(s) depends only upon the 
semi-simple component of x. Indeed (3.5.1) is an immediate consequence 
of the fact (see [13], p. 1031) that 


(3.5.2) y-z and y -+ cz are conjugate 


for any non-zero complex number c. 


We can now completely describe 6,. Proposition 10, 83.3, shows that 
the orbits of semi-simple elements are in a natural one-one correspondence 
with C+. We now observe (and this is more important for us) that the set 6, 
of all orbits of maximal dimension (n—1) is also in a natural one-one 
correspondence with C!. 


THEOREM 2. The map 
Ne! 0,> C? 


(given by the primitive invariant polynomials u,,- ' `, ui; see 83.3) is a 
bijection. l 

Proof. Let € C?}. Then by Proposition 10, § 3.8, there exists a semi- 
simple element y€ g such that u(y) =£. Now let z be a principal nilpotent 
element in g”. Then by Proposition 13, and (3.5.1) if s==y -4+ z then zer 
and f(x) ==-f(y) for all fEJ. Hence u(x) = € Thus (0s) =€ so that 
n. is surjective. 

To show that 7, is injective we must show that if z,,2,€r and u(z.) 
—=u(z,) then 2, and za are conjugate. Let 2;=»y,-+-%, (1,2, be the 
decomposition (3.1.2) for a. By (3.5.1) one has u(y:) =w(ys). But 
then, by Proposition 10, 83.3, yı and ya are conjugate. Hence we may assume 
that y—=ys—y. But since 2,,2,€r it follows from Proposition 13 that 
2, and z, are principal nilpotent elements of g”. But then by Theorem 1 
applied to g” it follows from Lemma 6, 83.2, that there exists a € G¥ such 
that az, — 2, Thus ar, = z, Q. E. D. 
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Since q, is a bijection we may invert it. For any £€ C? let O*(é) € 6, 
be the unique orbit O of dimension n—1 such that 7,.(0) = &.- 
3.6. Let {eg}, pE A, be a set of root vectors belonging to A. Let 


(3.6.1) m= > (e$) 
PEA, 


be the maximal Lie algebra of nilpotent elements defined by A, Let m* 
be the corresponding nilpotent Lie algebra defined by the negative roots 
A = — À, so that 


(3.6.2) g=m*+ġ+m 
is a linear direct sum. 


Let A be the Cartan subgroup of @ coressponding to h and let 
I = {4, @,° Ï +, %} CA; 


be the set of simple positive roots. (Here k—=1—dimz). For any EA let 
a? € C* be the non-zero scalar defined by 


(3.6.3) a(eg) = atep. 
Since @ is the adjoint group of g one knows that the mapping 
(3.6.4) A>(CH)* 
given by a— (a%,- - -,a%) is an isomorphism. 
Lemma 8. Let y€ g be semi-simple. Then the center of Gy is connected. 


Proof. If z is conjugate to y then Ge is conjugate to Gy and hence it 
is enough to show the center of G2 is connected for some sE Oy. Since all 
Cartan subalgebras are conjugate we may choose ze h. Moreover, by applying 
an element of the Weyl group W to a, if necessary, we may assume that g” is 
of the form 


(8.6.5) a5 +S (m) 


where II,.is some subset of the set of simple roots H and A, CA is the set 
all roots & of the form 
$ = > Tad, 


dell 
for integers na. 
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Let Z be the center of G> and let ac Z. It is then obvious that av—=v 
for any vE g7. Hence a€ A and a% = 1 for all «€ IM,. Since @ is connected 
(see Lemma 5, 83.2) the converse is clearly true. Hence 


Z = {a € A | a%=1 for all ach). 


Using the isomorphism (3.6.4) it is then obvious that Z is connected. 
i Q. E. D. 


Remark 14. The structure of G* is not as simple as Lemma 8, §3.6 
seems to indicate. In particular even though the center of G* is connected 
the subgroup of G* corresponding to the maximal semi-simple ideal [g”, g*] 
of g” may have a non-trivial discrete center. The structure of @* is analogous 
to that of the general linear group @l(d, C). 

Let M and B be respectively the unipotent and Borel subgroups of G 
corresponding to m and b == + m. l 

The orbits of maximal dimension (n—1) are uniform in the following 
respect. 


PROPOSITION 14. For any zer the group Gr is an abelian, connected, 
algebraic subgroup of G of dimension 1—dim3. (Recall that a is the center 
of g). 


Proof. By Proposition 11, § 3.4, it is immediate that g* is a commu- 
tative Lie algebra of dimension 1. Therefore to prove the proposition it is 
enough to show that G* is connected. 

Let e€ g be given by 


e= >) ee 
well 

Then by [13], Theorem 5.3, e is a principal nilpotent element of g. We ärst 
show that G° is connected. Let he G*. But [13], Corollary 5.6, m must be 
stable under A (this corollary asserts that a principal nilpotent element lies 
in one and only one nilpotent Lie algebra of the form (3.6.1)). But now 
since m is stable under % it follows that hE B. This may be proved in the 
following way. According to the Bruhat decomposition of @ (see [7]) we 
may write 

h=bs(o)g 


where b€ B, g€ M and s(o) is in the normalizer of A inducing the element 
c€ W on §. To prove h€ B it suffices to show that o is the identity of W. 
But this is obvious since h, b, g and hence s(c) leaves m stable (only the 
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identity element of W leaves A, stable). Thus a€ B. Write h==da where 
acAanddeM. Now since dE M 


h(e) = da(e) 
=a(e)tw 


where we [m,m]. But since h(e) =e and 
a(e) = > a%ea 
well 


(see (3.6.3)) it follows that w==0 and a(e)—e. The latter implies that 
a%==1 for all «€ I and hence by (3.6.4) a is the identity of G. Thus 
her d€ M. But then k may be uniquely written A=expadv where v€ m. 
But then by well known properties of nilpotent Lie algebras one has ve g° 
and hence A lies in the identity component of @¢ or since h was arbitrary G° 
is connected. 

Since all principal nilpotents of g are conjugate it follows that G* is 
connected for any principal nilpotent element z€ g. 

Now let x be an arbitrary element of r and let 2=y-+z be the decom- 
position (3.1.2) for z. We recall that, by Proposition 13, §3.4, z is a 
principal nilpotent element of the reductive Lie algebra g”. Let F be the 
adjoint group of g” so that applying what just proved (in the case of g) 
to g” it follows that F” is connected. Now by Lemma 6, § 3.2, the restriction 
of GY to g” induces an epimorphism 


(3. 6.6) Gu» F 


with kernel Z equal to center of GY. But now the full inverse image of F” 
under the map (3.6.6) is just GY N G = G? (see (3.4.8)). But since F” 
is connected and Z is connected by Lemma 8, 83.6, it follows that G? is 
connected. . Q. E. D. 


Remark 15. Note that if z€ r the abelian group G°? ranges all the way 
from a reductive group, (in the case where z is a regular element) to a uni- 
potent group (in the case where z is a principal nilpotent element). In the 
general case G7, for any z€r, is the direct product of a abelian reductive 
group and an abelian unipotent group. 

It seems suggestive from Lemma 5, §3.2, and Proposition 14, that 
possibly G* is always connected for any z&g. This, however, is false. If g 
is the Lie algebra of the exceptional simple Lie group G, and y == 3a + 28 
is the highest root where H = {a, 8}, then one can show that G* is not con- 
nected in case T= ĉa + ey. In fact one sees easily that G* contains the non- 
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trivial diagonalizable element a€ A where a*==1 and af =—— 1 whereas on 

the other hand the identity component of G* is unipotent. One proves the- 
latter statement by using the first line in Table 21, p. 186 in [5] (no X, term) 

together with the argument in the proof of Theorem 3, 83.7. 


3.7. It was pointed out to us by Dixmier that the following proposition 
is a special case of a more general result of Kirillov (all orbits of any Lie 
group for the representation contragredient to the adjoint representation are 
even dimensional). The simple proof given here is due to Kirillov and is 
easily modified to give the more general result. 


Proposition 15. For any z€ g one has dim Og is even. 


Proof. Let B be a G-invariant non-singular symmetric bilinear form 
ong. Now for any z€ g let Bs be the alternating bilinear form on g given by 


Bay, 2) = B(z, 1% z]). 


From the invariance of B it is clear that B,(y,2) =0 for all zeg if and 
only if y€ g7. It follows therefore that Be defines a non-singular alternating 
bilinear form on g/g*. But since such a bilinear form can only be carried 
by an even dimensional space it follows that dimg—dimg® is even. The 
proposition then follows from (3.4.1). Q.E.D. 


3.8. We now consider the cone P C g, defined as in §1.3 by J*. That 
is, P is the set of common zeros for all the polynomials in J*. 

The following proposition was essentially proved in [13] (it was proved 
for the case when g is semi-simple). 


Proposition 16. The cone P is identical with the set pCg of all 
nilpotent elements in g. 


Proof. IExe P then clearly ad v is nilpotent. Indeed if f,€ S is defined 
by fs(y) =tr(ady)! for any y€ g and positive integer j one has f;€ J* and 
hence f;(z) == 0 for all such j implies ada is nilpotent. On the other hand 
if z€ P then also ze [g,g]. In fact let T= t, -+ T£, be the decomposition 
of z according to (3.1.1) where z, € 3 and z2€ [g,g]. To see that z, is zero 
observe that every linear functional (element of 91) on g which vanishes on 
[g,g] lies in J*, But then one must have f(r) —=0 for all such linear func- 
tionale. Hence ze [g,g] and thus PŒ p (see the definition of nilpotent 
elements). But pCP by (3.5.2) since y==0 when z is nilpotent and 
f(0) = 0 for any fe J*. Q.E.D. © 

Now Theorem 1 together with Propostiion 16 above implies that (1) 
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P has a dense orbit (the set of principal nilpotent elements) (2) P is of 
dimension n— and (3) P is a finite union of orbits. On the other hand 
from the particular structure of J the cone P can be given by considering 
only the primitive invariants 4,¢€J. That is, 

P = {2€ g | u(r) = 0,1 = 1,2, + +, 0}. 


We now generalize Theorem 1, and thereby encompass every point of g, 
by proving a similar theorem after substituting any point in C? for the /-tuple 
of zeros above. 

For any £€ Ct, é= (&,- - +, &), let P(é), as in Proposition 6, §1.6, 
be the affine variety in g given by 


P(E) = {2€ g | u(t) tel. 
That is, with respect to the map u (see (3.3.2) one has 


(3. 8.1) P(é) =u (£). 

Thus l 

(3.8.2) a= U Péé) 
ec! 


is a disjoint union. 

Now recall (see end of 83.3 and §3.5) that O$ (£) and O*(£) are, respec- 
tively, the orbit of semi-simple elements and orbit of maximal dimension 
corresponding to any é€ C! under ng and nyp 

Now obviously P(£) is a union of orbits. In particular O®(£) and O*(é) 
are contained in P(é). Furthermore every orbit O lies in some P(£). 
Theorem 1 generalizes in the following way. 


THEOREM 3. Let éC C! be arbitrary. Then P(E) is the set of all rEg 
whose semi-simple component lies in O8(€). 


(3.8.3) P(E) = O*(€) U- - -U O8(£) 
is a union of a finite number of orbits. Moreover 
- (8.8.4) 0%) = P(é) Nr 


` and O*(é) is the unique orbit of maximal dimension (n—1) in P(£) and 
in fact 


(3. 8.5) dim OS (n—1) —2 
. for any other orbit in P(£). Next (2) 
, (8.8.6) 08 (é) = P(é) N8 
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and O®(£) is the orbit of minimal dimension in P(é). Finally 
(3.8.7) P(é) = O*(€) 

so that the Zariski closed set P(é) is irreducible and 

3.8.8) dim P(é) =n—l. 


Proof. The statement that P(£) is the set of all z € g whose semi-simple 
component lies in O%(£) is an immediate consequence of (3.5.1) and Proposi- 
tion 10, 83.3. This of course implies (3.8.6). Furthermore using (3.5.2) 
it follows from (3.8.5) that for any orbit OC P(é) one has 


(8.8.9) od) CO 
so that O®(£) is the orbit of minimal dimension in P(£). 


Now let y € O%(£) so that g” is a reductive Lie algebra. Let py denote 
the set of nilpotent elements of g”. Applying Theorem 1 to g” there exist k 
elements 2,€ p, t=1,---,%, such that under the adjoint group F of gy 
every nilpotent element in g” is conjugate to one and only one of the z. 
Furthermore Theorem 1 asserts that if N is the set of all principal nilpotent 
elements of g” then N is an orbit under F and N = py, 

Now put t= y + 2, i=1,-  ',k, so that by Remark 10, 83.1, y and 
% are, respectively, the semi-simple and nilpotent components of a. 

We now assert that every element in P(£) is conjugate to one and only 
one of the a. We first show that the z, lie in different conjugate classes. 
Assume aa,==2, for a€ G. Then by the uniqueness of the decomposition 
(3.1.2) one has ay =y so that ae @ and aq =z; But, by Lemma 6, § 3.2, 
z% is then conjugate to z; under F and hence t+—j. Now let veP(£) be 
arbitrary and let w and e be, respectively, its semi-simple and nilpotent com- 
potents. We show that v is conjugate to one of the a. -By the first statement 
of the theorem (already proved above) there exists a€ @ such that aw == y. 
Hence we may assume w =ey. But then s€ p” and hence by Lemma 6 there 
exists a€ GY such that ae = z% for some i so that av == q. Thus there sre 
only a finite (k) number of orbits in P (é). 

The statement (3.8.4) and the fact that O*(é) is the unique orbit of 
maximal dimension in P(£) is just a restatement of Theorem 2. The in- . 
equality (3.8.5) then follows by Proposition 15. 

Finally since N (see above) is dense in p, by Theorem 1, each a is in 
the closure of O*(£) so that, clearly, one has (3.8.7) and hence also (3.8.8). 


Q.E.D. 
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Remark 16. We can be very explicit about the number of orbits in P(£) 
for any £€C* Let y€ 0%(). By the argument above and Remark 13, 
83.4, if k is the number of orbits in P(é) then k—1 is the number of 
conjugacy classes of three dimensional simple Lie algebras in g”. But such 
classes have been listed by Dynkin (see [5]) for every simple Lie algebra and 
hence one knows k as soon as one knows the maximal semi-simple ideal [ gy, g¥]- 
in g’. 

We note also that (3.8.9) together with Lemma 5, 83.2, implies that 
the semi-simple orbits are the only closed orbits. 


COROLLARY 1. Let x€ g be arbitrary. Then Ö, is a union of only a finite 
number of orbits. Moreover if Cs is the (Zariski closed) complement of Os 
in Ö, then, where codim Ca is, as in 82.2, defined with respect to Og, one has 


codim C, = 2. 


Proof. If u(x) —é then obviously Ös C P(E) and since P(£) is com- 
posed of only a finite number of orbits the same is true for O,. But if OCC; 
then certainly 

dim 0, — dim 0 = 2 


by Proposition 15 and the fact that dim O < dim C» < dim Ös == dim Os. But 

then Corollary 1 follows immediately since C, must be a finite union of 

varieties of the form O where O C Oe . Q.E.D. 
As an immediate application one has 


COROLLARY 2. Let O be any orbit and let T be the set (Zariski closed) 
of all non-simple points of the affine variety O. Then if codimT is defined 
with respect to O one has 

codim T = 2. 


Proof. One knows that the set of all simple points of O is Zariski open 
in O and non-empty. It therefore meets O. Since @ is transitive on O it 
follows that all the points of O are simple. Thus T C Cs where O = 0, and 
hence the result follows from Corollary 1. 


Remark 17. It is suggestive from Corollary 2 that possibly O is a normal 
variety for any orbit O. This will be proved later (see § 5.1) for all orbits 
of maximal dimension. For such orbits it will also be seen that T is exactly 
the complement of O in O. 


4. The transversal !-plane b. 1. Now we recall that 9, the ring of 
polynomials on g and S4, the symmetric algebra over g (the ring of differen- 
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tial operators with constant coefficients on g) are G-modules and are paired 
by (1.1.1). By taking the differential (via the adjoint representation) they 
become g-modules and by (1.1.4) one has 

(4.1.1) <z- f> + a DO 


for all z€ g, de S and fE S. Furthermore any ze g operates as a derivation 
of degree 0 of S and 8, and hence, by (4.1.1), its action is completely deter- 
mined by its restriction to 8;. But the latter is given by 


- (4.1.2) al CR 


for any yE g. = 
Note that if de S, is of the form ð= xz, where rEg and 0,€ I, 
then by (4.1.1) 


(4.1.3) <8, f) = 0 for all fe J. 


This criterion for an element @€ 8, to be orthogonal to J is especially 
convenient to use when x equals a certain element to € h, now to be defined. 

Recall that ICA, is the set of simple positive roots. We now put To 
equal to the unique element in HN [g,g] such that (see [13], § 5.2) 


[Zo a> = 1 for all «€ I. 


If $€ A is arbitrary and the order 0(¢) of ¢ is the integer defined by 


(4.1.4) 0(¢) =È na (¢) 
where 

(4.1.5) . = Ži na(g)a 
then clearly 

(4.1.6) <0, $> =0 ($) 
and hence ` 

(4.1.7) [zo ep] = 0 ($) eg. 


As usual let Z denote the set of all integers. For every integer j € Z let 
SP = COE Sy | To ` 8 = 70S. | 


It is obvious that 9, is a graded subspace of 8, and since s, operates as a 
derivation of $ it follows immediately from (4.1.7) that 


= 


jez 
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is a direct sum and 


(4.1.8) 8,8, C BD, 


Similarly let g be the eigenspace of adz for the eigenvalue j so that 
g is a direct sum of the g4). Since adz, is a derivation of g clearly 


(4.1.9) [a®, g9] G 09. 
The decomposition (3.6.2) is related to z, in the following way. 


Lemma 9. The nilpotent Lie algebras m and m* may be expressed in 
terms of the eigenspaces g) of ada as follows: 


m = > gm, m* == > gm. 
J> I<o 


Moreover h == g) = g% (i.e. To is regular). 


Proof. Obvious from (4.1.7) and the fact o($) is positive for positive 
roots ¢ and negative for negative roots ¢. : Q. E. D. 


Since 9,“ is in the range of the action of s, whenever j +40 one has, 
by (4.1.3), 


(4.1.10) <ð, fy — 0 if FET, 0€ Sy where j £0. 


In the obvious way the symmetric algebra Są(u) over any ee 
uC g may be regarded as a subalgebra of 9,. 


Let b be the maximal solvable Lie subalgebra of g given by the direct 
sum 


(4.1.11) b=h+m 
(resp. put b* == m* + b). 


One knows that if g= gl(d,C) then f(z) depends only on the diagonal 
entries of z in case x is a triangular matrix and f € J. More generally one has 


PROPOSITION 17. Let x€ b* so that c—y-+0 where yE h and ve m*. 
Then for any FEJ one has f(x) =f(y). In particular 


u(x) =u(y) 
where u is the map (3.3.2). 


Proof. Since J is graded we may assume f€J*. Then, by (1.1.3), 
kif (z) =< (8s) k f> == < (ôy + 8y)*, f> ES <(8y)* +4, P = k!f(y) =f <ð, P where, 
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by binomial expansion, de m* + 8,(b*). But now by Lemma 9, 84.1 and 
(4.1.8) it follows that 
m* > 8,(6*) C38, 
3<0 
and hence <ô, f> = 0 by (4.1.10). Thus f(z) = f(y). Q. E. D. 


4.2. The following simple characterization of the principal nilpotent 
elements in m was given in [13]. 


THEOREM 4. Letecm. Write 
e= >) (966 
Beh; 
then e is principal nilpotent if and only if ca>£0 for every simple root a€ IL. 
Proof. This is just Theorem 5.8 in [18]. Q. E. D. 


Now for every simple «€ II let c’x be an arbitrary non-zero complex 
number (normalized in §4.4). We isolate a particular principal nilpotent 
element (by Theorem 5, after interchanging the roles of A, and A) e by 
putting 
(4. 2. 1) 6 = > Caba. 

aell 
The following lemma gives a very simple method for constructing elements 


in r (in fact by Lemma 11 and Proposition 10, § 3.3, at least a representative 
for every orbit of maximal dimension is constructed in this way). 


Recall that b is the maximal solvable Lie subalgebra 5 + m. 
Lemma 10. One has the relation 


e+bCr 
where, we recall, rt is the set of all ze g such that dim g? =I. 
Proof. For any j€ Z put | 
NEN g”. 


Then since e € g% it is clear from (4.1.9) that 


(4.2.2) ad e_(g9) C gd) 
and hence 
(4.2.3) go = Sa) 


. € jez 
is a direct sum. 
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Since e_€ r one therefore has 


(4.2.4) ¥ dima =]. 


jez 


Now filter g by putting 
(4.2.5) g= 2 g®. 
izj 


Thus (1) g2 gı for all j (2) g= gy for 7 sufficiently small and (3) g; = 0 
for j sufficiently big. 

Now let v€ b andz—=e_+v. But now by (4.1.9) one has 
(4.2.6) ad v (gs) Eg 


for all j. On the other hand since the gj induce a filtration 


g = 979 95 
on g? one has 
(4.2.7) 2 dim g/g? = dim g*. 
But now if 
(4.2.8) BF / 8a? > gP 


is the obvious injective map induced by (4.2.5) it follows immediately from 
(4.2.2) and (4.2.6) that the image of (4.2.8) lies in a, Thus © 


(4.2.9) dim gj°/gyj41° = dim a) 


for any j. Comparing (4.2.4) and (4.2.7) it follows that dimg*<1. But, 
by (3.4.2), dimg*=J. Hence dim g=} (and hence also the equality holds 
in (4.2.9) for any j). i 0 Q.E.D. 


Lemma 11. Let yEh be arbitrary. Put omety, Then zer and 
also u(z) =u(y). 


Proof. Since yeb one has z€ r by Lemma 10. On the other hand since 
e_€ m* it follows that u(x) == u(y) by Proposition 17, 84.1. Q. E. D. 


4.3. In $1.5 we defined the notion of a quasi-regular element z€ X for 
the general case of a linear group G operating on a vector space X. The 
notion is important for us because of Proposition 5, 81.5. The question as 
to which elements are quasi-regular, for the case at hand, is settled by 


PRoPosıTıon 18. The set r (all elements zeg such that dim g°=!1) 
is identical with the set of all quasi-regular elements in g. (See 81.5.) 
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Proof. In the case at hand P is the set p of all nilpotent elements. If 
zE g is quasi-regular then by definition Pp==p. Hence in particular if e€ p . 
is a principal nilpotent element there exists a sequence 2, j == 1,2, + -, such 
that z,€ Ooa where c;€ C* and such that z; converges to e. : 

Now let k==dimg*. We wish to show that k—I. By Proposition 12, 
83.4, it suffices to show that k< 1. Obviously dim gs — k so that dim ge —k 
for all j. Now consider the Grassmanian (which one recalls is compact) of 
of all subspaces of dimension k. Let u be a cluster point of the ge. It then 
follows easily (see argument in [13], p. 1003) that uC g°. But then tS] 
since dim g° =} and dmu—=k. Thus k=l and consequently zer. 

Now convereely assume that z€r. We wish to show that œ is quasi- 
regular. Since P, is closed and stable under @ to prove Ps = it suffices by 
(3.4.6) to show that P, contains a principal nilpotent element. 

Now let u(x). Then by Proposition 10, 83.3, there exists y€} 
such that u(y)=£ Put z,—e6e-+y. Then by Lemma 11, §4.2, and 
Theorem 2 it follows that z, € Os. The same argument shows that for any 
cE C* one has that z,€ Og where To= e. + cy. (One uses the fact that 
u(r) = u(y) implies u(cr) =u(cy) ; an immediate consequence of the homo- 
geneity of the w.) But now, obviously, z,—>e as c>0. Hence e € Pa 
But since e_ is principal nilpotent this proves z is quasi-regular. Q.E.D. 


4.4. Now for every simple root «€ II let Ca € C* be any arbitrary non- 
zero complex number. Let e, be the principal nilpotent element (see Theorem 
5, 84.2) given by 


(4. 4. 1) 6, = Ý, Cala. 
acm 


Since e, is principal nilpotent one has dim g* —. 
The following description of g* proved in [13] will play a fundamental 
role in this paper. 


THEOREM 5. There exists a basis z, t—=1,2,---,1, of g* such that 
(see $4.1) 


(4. 4. 2) z Eg) 
where, we recall, m, is that integer given by 
deg u = m, + 1 


and mE J is the i-th primitive invariant polynomial (see 83.3). 
In particular then 


(4. 4, 8) g%* Ch. 
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Proof. When g is simple the first statement here is just the 2nd and 8rd 
from the last statements of Theorem 6.7 in [13] (our z here is the tų of that 
theorem) together with Corollary 8.7 (which shows that k= m) of [13]. 

If g is semi-simple the first statement is still true since e, may be written 


l, = >= 64,4 
4 


where the e,, are principal nilpotent elements of the various simple components 
of g and each is of the form (4.4.1) for the corresponding simple component. 
One then uses the fact that the exponents (the m,) of g are composed of the 
exponents of the various simple components of g. 

In the general case the first statement of the theorem aiso follows since 
if 3 is the center of g then m;==0 if and only if iS dima. But clearly 
a =g“ N g. 

Since the m, are non-negative integers the relation (4.4.3) follows from 
Lemma 9, §4.1. Q.E.D. 


Remark 18. Subject only to the conditions of Theorem 5, $4.4, it is 
obvious that the basis of primitive polynomial invariants u; does not uniquely 
determine the basis z; of g*. However with the further relations uncovered 
in 84.6 we wish to note that the u do uniquely determine a basis z; of g*. 

Now one knows the elements Ta € h, «€ II, given by Ta = [éa, 8-a], form 
a basis of hM[g,g]. Hence we may write 


To = > Tala 


acel 
where z, is defined as in § 4.1. 
Now define 
= I Ta/Ca 8-a 
ael 


where the ca define the principal nilpotent element e, (see (4.4.1)). Then as 
observed in [13], 85.2, the elements e”_, x, and e, form a basis of a principal 
three dimensional simple subalgebra a, of g. Furthermore this basis satisfies 
the commutation relations of an S-triple (see [13], p. 996). It is obvious 
then that e’_ is conjugate to e, and hence e’_ is a principal nilpotent element 
of g. By Theorem 4, §4.2, one must therefore have that ra540 for any 
a€ H and hence we may normalize the C'a of (4.2.1) by putting 


Cam Taf Ca 
so that e = g. 


Now if V is any finite dimensional irreducible module for the three 
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dimensional simple Lie algebra a, with respect to a representation m then one’ ` 
knows that V is a direct sum of Kerr(e,) and Imr(e_). Since any finite. 
dimensional a,-module is completely reducible the same must be true without 
the assumption of irreducibility. It follows therefore from (4.2.2) and 


(4.4.3) that by restriction to b we have proved. i 


Lemma 12. Let b be the maximal solvable subalgebra of g gwen by 
(4.1.11). Then 


(4. 4. 4) b= g + ad e_(m) 
is a direct sum. 


4.5. A subset u C g will be called a plane if it is of the form u = w +a 
where wE g is an element and a is a subspace. (It is called a %-plane if — 
dim a = k.) : 
It is obvious that a k-plane u is a k-dimensional affine subvariety of g. 
Furthermore $(u), the restriction of S to u, is the affine algebra of u and 
in fact if, as above, u=<=w-+ta then writing an arbitrary ze u in the form 
k 

z=w-+ Ur(z)yı where y; is a basis of a it is clear that the r; are.in S(u) 
#1 y 

and define a coordinate system on u. Moreover one obviously has 

(4. 5.1) 8 (u) Clr: £ "fgl. 

Note also that if f€ 9 and g =f | u then 


(4.5.2) ðg/ðr; = ôy, f | u. 
Now let 
u: u> Ct 
be the restriction of u to u. The plane u will be called transversal if 
l dimu, (u) —1. 


Since u, is a morphism it is clear that u is transversal if and only if the . 
functions 14€ S (u), where =w |u, are algebraically independent. But 
this is the case if and only if the Zariski open subset u, of u given by 


Uo = {7€ u | (dv), i= 1,2,: - -,], are linearly independent} 


is non-empty (see proof of Proposition 6, §1.6). But by (4.5.2) ito is the 
set of all points z in u where the kX? matrix (d,,u) (©), +—1,--°-,1, 
j=1,:*-+,k,is of rank 1. Thus (to make it independent of the basis y; of a) 
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if d(u) C9 (u) is the space of functions on u spanned by the determinants 
of all 2X I minors of ôy | u (put equal to zero if k <1) then 


(4.5.3) u is transversal if and only if dimd(u) 21 
and j 
(4.5.4) Uo = {T7 € u | g(x) 0 for some g € d(u)}. 


Now if u is an l-plane then obviously dim u is either 1 or 0 (according 
as to whether u is transversal or not). In case u is a Cartan subalgebra, 
say 5, then we have already observed that u is transversal. In fact 


(4.5.5) d(h)—=( II $) 
Beh, 


and o == 1, is the set of all z€ ) which are regular in g. (See (3.3.5).) 
Although § is transversal it is not suitable for our needs, mainly because 
both. 
On the other hand if we put b equal to the /-plane given by 


(4.5.6) b= e -Hga . 


then not only is b transversal but it will also be shown (1) that d(b) =C 
so that b>. Moreover it will be seen that every element of p lies on an 
orbit of maximal dimension and every such orbit meets p in one and only 
one point. 


Remark 19. In a sense b is to r as § is to 8, the set of all semi-simple 
elements in g. However p has the advantage in that there are no “Weyl 
group ambiguities” with regard to conjugation. Furthermore the restriction 
of J to h induces only a monomorphism of J into S(h) whereas (by Theorem 
8, §4.7) the restriction of J to b induces an isomorphism of J onto S(b). 

Remark 19’ (added in proof). If a is any linear complement of ad e_(m) 
in D which is stable under ad, it is clear that a may be substituted for g% 
in Theorem 5. We now wish to observe that if a is substituted for g* in the 
definition of b above (see (4.5.6)) then all the results to be proved hence- 
forth about b will still hold true. That is, the only properties of g needed 
are Theorem 5 and (4.4.4). In this generality the results contain Theorem 
0.10 of the Introduction. In particular they apply to the special case of the 
plane of companion matrices. (See Remark following Theorem 0.10.) 

In order to show first that b is transversal the following obvious fact will 
be useful. Assume that u and w are planes and that y: u— w is a morphism 
defined so that j 


(4.5.7) Uy O Y = Uy. 


4 
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Then clearly (since u,(u) C up(w)) 
(4.5.8) u is transversal implies iv is transversal. 


The following proposition asserts among other things that every element 
of the l-plane e_+- is conjugate to an element in the ]-plane b. 


PROPOSITION 19. For each element z& e+ there ewists a unique 
element a,€ M such that as(x) €p. Furthermore the map 


(4.5.9) e.-+5>M 
given by <> a, is a morphism. 


Proof. Let ,i=1,2,: : ‚m, be a basis of m so that &€ g for some 
j>0. (See Lemma 9, 84.1.) In fact let r(?) be that positive number such 
that se g”. We may then order the basis & so that r(t) £r(#-+1) for 
all 4. 

Now let w= [e e-]. Then since g*Cb* (by (4.4.3) after inter- 
changing A, and A), so that g-Nm= (0), it follows that 


w € gr) 


and the w; form a basis of ad e_(m). 
Obviously one has 


(4.5.10) Mx(_+h)>e+b 


for the map (a,x) —>.az. 


Now foranyvee_+blety(v), t-=1,2,: - -,m, be the scalar defined so 
that if v is uniquely written v = e- -+ v, + vz where v, € g* and v€ ade_(m), 
according to the decomposition (4.4.4), then 


Vg == S (v) w. 
{1 


We now make the following inductive assumption about a positive integer 
k. There exists & functions g€ S(e_+h), i—=1,2,:--,k, such that if 
z € m where 


z = > dies. 
421 
Then one has for any z€ e +p, 


c (expadz(z)) = 0 forall jk 
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if and only if 
(4.5.11) bı — gi (T) 
for all iS k. 
We now show that the assumption holds for k +1. Indeed if we compute 


Cr = Cen (exp ad 2(2)) where z satisfies (4.5.11) it is straightforward, using 
(4.1.9), to see that 


(4.5.12) Cen = brn + folgi (e) (2) 
+È Alale): ` c, ga(2))r (2) 


where f, t+==0,1,---,1, are polynomials in k variables and r;€8 (e-+ h) 
is the same as in (4.5.1) with u == e_ -+ }. 

Now consider the equation Cr =0. Since (4.5.12) is linear in br 
we can obviously uniquely solve for bi: obtaining br == gr.(2) where 
gr E€ S(e.+ 5). Thus the induction assumptions hold for «+1. On the 
other hand (4.5.12) is also valid for k=0 provided fy—0O and fı are 
constants for t—=1,2,:--,1. Thus, similarly, the induction assumption holds 
for k = 1. 

We have thus proved inductively that given s€ e -+b there exists a 


unique element =Š g(t) 44 in m such that q(expadz(z)) <0 for t==1, 
=1 


2, m. That is, such that expadz(z) E€ b==e_+ g^ and that further- 

more gE 8(e-+ 9). But if a,—expadz this proves the lemma since one 

knows the map m—> M given by z— expadz is an algebraic isomorphism. 
Q. E. D. 


Proposition 20. For every sE e + h let a,€ M be defined as in Proposi- 
tion 19. If now 


p: @.+h—->b 
ts the map given by c—>a,(z) then p is a morphism. 
Proof. Obviously the map (4.5.10) is rational and everywhere defined. 
But by Proposition 19 so is the map 
(4. 5.18) e+h—> MX (e +5) 


given by > (0,2). One obtains the proposition by composing (4.5.10) 
with (4.5.13). 
We can now prove 


Lemma 13. The l-plane p= e + g* is transversal. 
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Proof. Let p be as in Proposition 20. Since p(x) € Os for any sE 6e +} 
it is obvious that 
Uy © p = Uy 
where u=e_+h. Thus, by (4.5.8), to prove b is transversal it suffices to 
show that u is transversal. But if: 


ri hou 
is the map by 7(y) = e-+ y then of course r is a morphism. On the other 
hand by Lemma 11, 84.2, 
U OT — Up. 
Thus by (4.5.8) to prove u is transversal it suffices to show that h is trans- 
versal. But h is transversal by (4.5.5). Q. E. D. 


4.6. Now let %,+—1,2,- - l, be the basis of g^ given by Theorem 5, 
84.4. We recall that 4€ g). On ‘the other hand one has deg u— m; + 1. 
Hence if we put 


(8a) ™ 
(4.6.1) gı = m 





then g,€ S*. That is, g, is just a linear functional on g. 
Lemma 14. Let lSi,jSl. Then 
9(2) =0 
whenever m, z£ my. 
Proof. Since g; is a linear function on g one has, by (1.1.2) and (1.1.3), 
(4.6.2) m!gu(2) = < (de) "e un) 


for any z€g. But since e € g one has (d,) mE Sy") by (4.1.8) and, 

if z€ g®, then also (ô, )™ô, E€ Sm, But if k4 my, that is, if k—m,540 

then g;(z) = 0 by (4.1.10) and (4.6.2). In particular g;(z;) =0 if Mj 1m. 
Q. E. D. 


The following lemma is crucial. Recall that 5 is the maximal solvable 
algebra given by (4.1.11). 


Lemma 15. Let l1SijSl. Then if ms m; the function 0,,t4 reduces 
to a constant on e +b. In fact 


(4. 6.8) du, | + b = gi (33). 
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Furthermore, if m, < m; then the constant ts zero. That is, in this case 
(4. 6.4) du | e-+ 5 = 0. . 


Proof. We first observe that if ze e +b then for any non-negative 
integer k one has 


(4.6.5) -o (aE SS. 
p-k 


Indeed this is clear from (4.1.8) and Lemma 9, § 4.1, upon writing z = e- + y 
where y€ b and using binomial expansion.. In fact from the binomial expan- 
sion it is obvious that («4 )* is the component of (9,)* in S,™. That is 


(4.6.6) (Be)? — (3a) E E 8,0. 
D>-k 


Now if feJ it follows, since z;€ g "9, that by (1.1.2), (4.1.8) and 
(4.1.10) 


(4.6.7) <ð, bs f> =D 


for all de S,® where p-4— my; in particular for all p > — my. 


But now if k= m, in (4.6.6) then the sum there is over all p where 
p>—m, Hence if m Sm, so that — m, Z — m, the sum in (4.6.6) is 
over all p, where p > — m; Thus, by (4.6.7), 


(4.6.8) < (ba) t, 06,f> = < (Oa), Bof 


for all z€ e-+ b whenever m; & mj. 
We now assert that this implies 


(4.6.9) (Osju) (z) = gi (2;) 


for any zE e -+b whenever mS mj. Indeed replace f by u; and divide by 
m! in (4.6.8). Recalling that deg 0,,u, == m; the left side of (4.6.8) becomes 
the left side of (4.6.9) by (1.1.3). On the other hand by (1.1.2) the right 
side of (4.6.8) becomes the right side of (4.6.9) by (4.6.2). (Recall that 
8, is commutative.) This proves (4.6.3). 

But now if m; < m; then the right side of (4.6.9) vanishes by Lemma 14. 
Hence one obtains (4.6.4). Q.E.D. 


We can now show that the Jacobian matrix of functions 9,1% | b of the 
map u, takes triangular form and reduces to non-zero constants along the 
diagonal. 
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THEOREM 6. There exists a unique basis 2, j= 1,2, < ',l, of g% such 
that for +—=1,2,- >>, 
(4.6.10) (2) = dy. 
Furthermore the basis satisfies the condition of Theorem 5. That is zy € gi 
for all j. Furthermore 


(4.6.11) du | 0 — 1 a 
so that not only is b transversal but in fact 

(4. 6.12) det A, | D= 1 

and hence (see § 4.5) 

(4.6.13) d(b) —= C. 


Proof. An integer k will be called an exponent if k == m, for some t. 
Let E be the set of exponents and for any k€ E let Py G {1,2,: - +, 1} be the 
set of all i such that m= k. Now, for any k€ E put 


by — det glz) . 
tJ €P» 


It then follows from Lemma 15 that det ô, is a constant on ¢.+5 and 
int 
det 9, | e- + b = [I br. 
eek 


But since p C e-+ b and since b is transversal (Lemma 13) this constant can 
not be zero. Thus 0,540 for any kE E. That is, the matrix g,(z;), ù j E€ Pi, 
is non-singular and this holds for any ke F. It follows immediately then 
from Lemma 14 that a unique basis 2, of g* exists so that (4.6.10) is satisfied. 
It is also clear from Lemma 14 that the 2, necessarily satisfy the condition 
of Theorem 5. Since b C e- -+ b the remaining statements follow from Lemma 
15. Q.E.D. 


4.7. We will assume from here on that the basis z; of g% is given by 
Theorem 6. Now let s;€ $(b) be the coordinate functions on b corresponding 
to the z. That is, s; is such that z = e- +- $, s;(£)z; We have already noted 
that S(b) —C[s.,- - -,8;] (see (4.5.1)). 

In notational simplicity let 


t: b> C! 
(instead of u,) denote the restriction of u to b. Thus for any z€ b 
t(2) = (ua), +, &(2)) 
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where = 4 | b. It follows therefore from (4.5.2) that 


at, 
(4.7.1) Js, T G0 | b. 


Now if u is an arbitrary k-plane in g let 
(4. 7.2) J—> 8(u) 


be the ring homomorphism obtained by restricting an invariant polynomial 
to u. Now in general one could hardly expect (4.7.2) to be an isomorphism. 
Indeed if (4.7.2) is an epimorphism one must have k= 2 and if (4.7.2) 
is a monomorphism one must have kI (since the uù, are algebraically 
independent). Hence the possibility could only exist if k=l. If u is a 
Cartan subalgebra the one knows that (4.7.2) is a monomorphism and the 
image is the space of Weyl group invariants. Hence in such a case (4.7.2) 
is an isomorphism only when g is abelian. On the other hand when u == h 
we have, in general, the following corollary of Theorem 6 


THEOREM 7. If u==b then (4.7.2) is an isomorphism. Moreover the 
map 
(4.7.3) l t: bC! 


obtained by restricting u to b is an algebraic isomorphism so that t,,- * >, ti 
define a global coordinate system on b. 


Furthermore the relationship between the t and the linear coordinates s; 
on b is as follows: For 1=1,2,- - -,1, there exists polynomials p; and qı in 
i— I variables without constant term such that 


(4.7.4) b= 8 F Pils,‘ 864) 
and 
(4.7.5) s= h t a(t: tima) 


Proof. To prove the theorem observe that it suffices only to prove (4.7.4). 
Indeed using (4.7.4) we can solve for s; obtaining (4.7.5). It is then: 
immediate that ¢ is one-one, onto and is in fact a biregular birational map. 
Since the 4 generate the image of J in 8(b) it is then also obvious that (4.7. 2): 
is an isomorphism. 

But now (4. 7. 4) is immediate from (4.6.11) and (4.7.1). 

Finally by definition of the coordinate system s, one has s,(¢.) —0 for 
all i On the other hand &4(e_) = for all ¢ since ¢(a.) =w(6_) == 0 (recall 
that e_ is nilpotent). Thus the p; and q; have no constant term. Q.E.D. 
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Any orbit O of semi-simple elements (i. e., O € Ög) intersects h in a finite 
number but in general more than one point. We now find that any orbit O 
of maximal dimension (i.e. O € Ö,) intersects v in one and only one point. 


THEOREM 8. One has vCr. Furthermore tf 
(4.7.6) bp 6, 


ts the map gwen by £— Os then (4.7.6) is a bijection. That is, no two 
distinct elements of b are conjugate and every element in r ts conjugate to 
one and only one element in b. 


Proof. Since »Ce-+b one has pCr by I Lemma 10, ‘$4.2. But now 
if we compose (4.7.6) with the bijection n; (Theorem 2, 83.5) we obtain 
the bijection t (see Theorem 7). Hence (4.7.6) must be a bijection. Q. E. D. 

We can now obtain the following characterization of the set r. ° 


THEOREM 9. Leizeg. Thenzerifand only if (dus). t= 1; 2,7 yd, 
are linearly independent. 


Proof. By (4.6.12) the matrix (4,4) («) is of rank } for any zen. 
Thus (du). +—1,-- -,1, are linearly independent for any x€b. But then 
by Theorem 9 and conjugation the same is true for any zer. 

Now let x¢€g but where sér. We must prove that the (du), 
i= 1,2,' - -,l, are linearly dependent. Assume first that z€ 8 (that is, z is 
= Then z is not regular so that g° contains a Cartan subalgebra 
as a proper subalgebra. It follows therefore that if u is the center of g? and 
la = dim u one has I, < l. 

Furthermore it is also clear that u is the set of fixed vectors for the 
action of G? on g (recall that Ge is connected. See Lemma 5, 83.2). Thus 
there exists a non-abelian simple component g, of g of rank, say h, such that 
in the notation of §2.1 

dy* <1, 


where y € D and the irreducible representation » is equivalent to the adjoint 
action of Gon gi. (One uses here that » is self-contragredient.) But then 
by Proposition 8 the multiplicity of »* in the G-module R(G/G@*) or R(O,) 
is less than l. But S(O.) CR(0,) (in fact here S(O.) —=R(0,) since Os 
is closed. See (2.2.8)) so that the same is true for the G-module S(0,). 
Now let ga be an ideal in g complementary to g, so that g = gı @® gz is 

a direct sum. It is obvious that we may choose the primitive invariants 80 
that for SH <%< -<i Z] one has \ 


Ui, (T1 -F T3) — ty, (T1) 
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where jE gy, j= 1,2, and k==1,2,---,l. (The dependence or indepen- 
dence of the (ds), obviously does not depend upon the choice of the primitive 
generators u,). That is, for any such k, 


(4.7.7) y (tap) = 0 for any yE ge 
Now for any uE J, y€ g and ae G one clearly has 
(4.7.8) a- byu = days. 


Now let y be the root vector eg where ¢ is the highest root of gı. It 
follows then from’ (4.7.8) that d,ue S¥, and hence du | Os E€ 9Y (0a), and 
in fact, if not zero, these functions are highest weight vectors. But then since 
the multiplicity of in 8(0,) is less than 1, it follows that 9,1, | Os 
k=1,2,' ' ,lL, must be linearly dependent. Thus there exists scalars Ci, 
not all zero, such that if u == z u, then du | O,—0. But then by (4.7.7) 


and (4.7.8) one has &u | Oa =O for all z€ g. In particular then 
(du) (2) ==0 for all z€ g. 


Thus (du) = 0 and hence the (du)„i=1,2,: --,1, are linearly dependent. 

Now assume that z€ g is arbitrary where sér. Since the set of all y 
such that the (du), are linearly independent is an open set (see §1.6) to 
prove the theorem it suffices from above to show that there exists a sequence 
a, such that 2,—> x where the z, are semi-simple but not regular. In fact it 
suffices to show this for the case where x is nilpotent. Indeed if z=y-+-z 
is the decomposition (3.1.2) for s then by Proposition 13 z is not a principal 
nilpotent element if g”. Hence if such a sequence has been shown to exist 
in the nilpotent case there exists a sequence y, of non-regular semi-simple 
elements in g” such that „y—z. Hence x = y +- yp converges to s. But 
clearly z, is semi-simple and non-regular in g. 

Hence we may assume that x is a -non-principal nilpotent element of g. 
By conjugation we may also assume rem so that, by Theorem 4, § 4.2, 
z ot where there exists a simple root «EU such that ce==0. Let 

€ 


n= > (%) 
geA, 


so that zen. Also let y€ ġ be such that <ß,y> is positive for BE II where 
B Aa and <a,y>—0. It follows therefore that y is semi-simple and non- 
regular. Furthermore it is clear that n is in the range of ady. In fact 
[y,n]==n so that by the argument of Theorem 3.6 in [18] (See Note 
following this theorem) every element in y -+ n is conjugate to y. In particular 
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y-+z is conjugate to y and hence is semi-simple and non-regular. But we 
may substitute y/k for y. Hence if ,—y/k-+ a then z,—2 where £p is: 
semi-simple and non-regular. Q.E.D.. 


4.8. Generalizing the definition of J*, let Jt, for any é€ C}, be the 
(maximal) ideal in J generated by w%—&, i==1,2,---,1. Obviously then 


JE = (th — és" ++, ti—&) 
Recall that P(£) C g is the set of zeros of JES. We can now prove 


THEOREM 10. Let ¿c C! be arbitrary. Then P(E) is a Zariski closed 
subvariety (of X) of dimension n—l and its ideal I(P(£)) is given by 


(4.8.1) 1(P(€)) = J's 


so that (a) P(£) is a complete intersection and (b) JES ts a prime ideal.. 
Furthermore tf P(€), ts the set of simple points of P(E) then 


(4.8.2) P(£)a = O" (é) 


where O*(€) is the unique orbit of dimension n—rin P(£). (See Theorem 4, 
83.8). Moreover the set of non-simple points in P(E) is a finite union of 
orbits and has a codimension of at least 2 in P(é). 


Proof. By Theorem 3, § 3.8, P (¢) is a Zariski closed subvariety of dimen- 
sion n —l and P(£) Mr is the orbit O*(£) of dimension n —! defined in 83.5. 

But if zeP(£) then (du). t= 1,2,:--,1, are linearly independent 
if and only if ze O*(€) by Theorem 9, § 4.7. Hence by Proposition 6, § 1.6, 
one obtains (4.8.1) and (4.8.2). Furthermore the set of non-simple points 
of P(£) is a finite union of orbits and have a codimension of at least two in 
P(é) by Theorem 3, §3.8. Q.E.D. 


Remark 20. By (4.8.2) note that P(£) is a non-singular variety if 
and only if O*(é) == P(é) ; that is, if and only if O®(£) is an orbit of regular 
elements. 

Now let B be a non-singular symmetric G-invarient bilinear form on g. 
(One extends the Cartan-Killing form of [g,g] in an obvious way.) 

Let HC g be the graded space of G-harmonic polynomials defined as in 
81.4 so that S=J*S + H is a G-module direct sum. 


Remark 21. By Proposition 16, §3.8, note that the subspace Hp CS 
(see 81.4) is the space of polynomials spanned by all powers of gre St, 
k—0,1,---, and all linear functionals ge St corresponding to ôs, under 
the map (1.4.1), where z is an arbitrary nilpotent element of g. . 
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Finally for any A€ D recall that h is the multiplicity the zero weight 
for the representation ». That is, I = d4 for any Cartan subgroup 4 G G. 
(See § 2.1.) 

We can now prove 


THEOREM 11. Let g be a complex reductive Lie algebra and let 8 be 
the ring of all polynomials on g. Let G be the adjoint group of g and let 
JCS be the subring of G-invartant polynomials. Then § ts free as a J- 
module (under multiplication). Furthermore 


(4.8.3) H = Hp 
and if 
(4. 8. 4) J®H>S 


is the map given by u®h>uh then (4.8.4) is a G-module isomorphism. 
Also for any €€ C! the ideal JES is prime in 8 and 


(4.8.5) S—JS+H 


is a direct sum. 


Moreover H ts completely reducible as a G-module and for any AED 
the irreducible representation v of G occurs with multiplicity I, in H (so 
that H — H` is a direct sum and dim H` == hd, where d, is the dimension 
of 2). eD 

Let r be the set of all zE g whose corresponding orbit Os has maximal 
dimension (n—1). Leixerandlet S(O.) be the ring of functions on 8 (0x) 
obtained by restricting S to Os and let 


(4.8.6) H —> 8 (0s) 


be the map obtained by restricting G-harmonic functions to Os. Then (4.8.6) 
is a G-module isomorphism so that all S(O,), for zEr, are isomorphic as G- 
modules. 


Proof. By Theorem 1, §3.4, and Proposition 15, §3.8, the cone P has 
a dense orbit and by Theorem 10 J*S is a prime ideal (case where £==0). 
One obtains (4.8.3) and (4.8.4) as a consequence of Proposition 4, § 1.4. 
Moreover the map (4.8.6) is an isomorphism by (1.5.2) and Proposition 18, 
§ 4.3. Since JÉG is prime by Theorem 10 one therefore obtains the direct 
sum decomposition (4.8.5) (using 3.8.7)). 

Obviously H is a completely reducible G-module. To find the multiplicity 
of A in H one uses the isomorphism (4.8.6) and chooses s to be regular. 
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In such a case R(0,)—=5(0,) by (2.2.3) since Og—=O,. But the multi- 
plicity of A in R(O,) is h by Proposition 8 since G* is a Cartan subgroup 
of G. Q.E.D. 

Remark 22. Except for (4.8.8) note that by Proposition 2, 81.3, one 
may. replace H in Theorem 11 by any @-stable complement of J*S in 8. 

Also we wish to note that every irreducible representation of G appears 
with positive multiplicity in H. That is =1 for any A€ D. Indeed let 
Z CH’ be the discrete subgroup generated by all roots ¢€ A. Since G is the 
adjoint group one knows that every weight of yè can be regarded as an element 
of Z. On the other hand if D is identified with the subset of all pE Z such . 
that u(z29) = 0,for all € A, where zy € h is the root normal corresponding 
to œ, in such a way that A is the highest weight of +ò then it is known that 
any „ED is a weight of vò if and only if A—» is a non-negative integral 
combination of positive roots. Since u= 0 always satisfies this condition it 
follows that h = 1. 


Remark 22’. It has ee pointed out to us by Serre, as we ourselves 
have also noticed, one of the conclusions of Theorem 11, namely $=J®H, 
can be obtained directly from the theorem of Chevalley mentioned in Example 
1 of the Introduction. , 


(Added in proof.) As used above, the primeness of J+S implies that 
J*§ is the ideal of the variety P. Another application of this fact in algebraic 
geometry is the following theorem. 

Clearly P meets the Cartan subalgebra h (or any Cartan subalgebra) 
only at the origin and dim P + dim} = dim g. | 


THEOREM 12. Let w be the intersection multiplicity of P and h at the 
origin. Then w is the order of the Weyl group. 


Proof. Let L be the local ring at the origin (as a point of g) and let J and 
K, respectively, be the prime ideals of L corresponding to h and P. Now 
one knows that w is the alternating sum of the integers dim Tor,” (L/I. aa ). 
But clearly 
dim Tor” (L/I,L/E) = dim Tors (8 (b), 8 (P)) 


We now observe, however, that by Theorem 11 one has Torf (8S (9), S(P)) —0 
for +> 0. Indeed since 8 is J-free and S(P) —S/J*S there is a spectral 
sequence converging to Tor(S(bh),S(P)) where 


Epa = Tor,5® (Tora (8 (5), C), 8(P)) 
(See Cartan and Eilenberg, Homological Algebra, Chapter XVI, § 6, Theorem 
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6.1, p. 349). On the other hand since $(h) is J-free (See [2]) one has 
E,g@@=0 unless p=q=0 and Hy.?=S(h)/J*S(b). This verifies the 
observation and also proves that 

(4.8.7) v=dimS(h)/J*8(h). 


But by [2] (and also from the cohomology theory of the generalized flag 
manifold) one knows that the right side of (4.8.7) is the order of the Weyl 
group. Q.E.D. 


4.9. Now let p(¢) be the formai power series 
p(t) => dim H*#*, 
> 


Since S is isomorphic to the tensor product J®H by Theorem 11 it 
follows therefore that 


Ii-ım 
(4.9.1) p(t) "df 


Now let g denote the projective space of all one dimensional subspaces 
of g and let 
(4.9.2) g— (0)>$8 l 
be the canonical projection map. If u is a homogeneous Zariski closed sub- 
variety of g let UCg be the image of u— (0) under (4.9.2) so that u is a 
projective variety. - 

In the remaining portion of this section we use the notation of FAC, [15]. 

Consider the projective variety pC g defined by the cone p of all nil- 
potent elements in g. The dimensional determination of the sheaf cohomology 
groups AJ (p, @(%)) for all }, k€ Z is given by 

THEOREM 13. Let ké€ Z be arbitrary. Then 
(4.9.3) H! (p, 6 (k)) —0 
where j ts any integer other than 0 or n—I—1. On the other hand 

u =- gl (kin 

(4.9.4) OR) — ameg, o EEN), 
(Recall that n —} is even.) 


Furthermore if q(t) is the formal power series defined by 


(i) — È dim E(P, 0 (k))# 
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then q(t) = p(t). That ts q(t) may be given by 


nag 
(4.9.5) q(t) Fae 


Proof. By Proposition 15, 83.8, one has p= P. Hence by Theorem 10, 
for &=0, one has that p is a complete intersection so that Proposition 5, 
§ 78, in [15] is applicable. This yields (4.9.3) and (4.9.4) since clearly 
N=—=1—n. On the other hand in the notation of [15] one has dim H°(p, Ö(k)) 
—dim 8*(p). But since J*S is the prime ideal of P by (4.8.1) and since 
S=J*S+H is a direct sum it follows that dim H* = dim S*#(p). Thus 
p(t) ==g(t) and hence one obtains (4.9.5) from (4.9.1). Q.E.D. 


4.10. One obviously has an isomorphism f—f* of J onto the ring 
5 (C!) of all polynomials on C! by defining, for any é€ C}, 


P(E = p (éo +» 81) 


where p is that polynomial in I variables such that f = p (un: ` *,%). We 
recall that the w are the primitive invariant polynomials, " 

Now let U be the set of all Zariski closed subvarieties of €*. We may use 
U to index all the prime ideals in J by defining JUC J for UE U to be the 
prime ideal consisting of all f€ J such that f* vanishes on D. 

If J CS is any prime ideal in § let u(Z) Cg be the corresponding Zariski 
closed subvariety of g of all points in g at which J vanishes. It is of course 
obvious that J is stable under @ if and only if u(/) is stable under the action 
of G on g; that is, if and only if u is a union of orbits. It is clear of course 
that if I is generated by invariant polynomials then J is @-stable. However 
this is not a necessary condition. The question arises: how does one charac- 
terize all those G-stable Zariski closed subvarieties u of g whose prime ideal 
I(u) is generated by invariant polynomials? The following theorem asserts 
that a necessary and sufficient condition is u N r should not be empty. Note 
that since r is a Zariski open subset of g (obvious from its definition. Also 
see the proof of Proposition 6, §1.6) then uMr is Zariski dense in u in 
case uNr is not empty. Theorem 14 also generalizes most of Theorem 10 
(case where U has only one point). 


TuHeorem 14. Let JUCJ, UEU, be any prime ideal in J. Then 
JUS is a prime ideal in S and 


(4.10.1) u(JV8) u 
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That ts, u(J9S) =u (U) where u is the map (3.3.2). Moreover 
(4. 10.2) U->u(J78) 


defines a one-one correspondence between the set of all Zariski closed sub- 
varieties of C? and the set of all G-stable Zariski closed subvarieties ug 
such that uO r is not empty. In particular U —u(u) is in U for such a sub- 
variety uC g, u==u(J78) and 


(4.10.3) unre [U OF(é). 
EU 
Let VEU and put u=u(JVS). Then 
(4.10.4) codim U in Ct = codim u in g. 


Furthermore if vE uN r then x isa simple point of u tf and only if u(x) is 
a simple point of U. Finally if r° is the (Zariski closed in g) complement of 
rin g then 


(4. 10.5) codim uf re (in u) > 2. 


Proof. Let J’ be any ideal in J. It is immediate that J’S is the image 
of J’@ H under the isomorphism (4.8.4) and hence one has 


(4.10.6) IRA 


Now assume that J’ is a radical ideal (an ideal equal to its own radical) 
in J. We will show that J’S is a radical ideal in 8. 

Let J’, be the radical ideal in S (C?) corresponding to J’ under the iso- 
morphism J — 8(C') where f>f* and let U CC? be the Zariski closed set 
of all €€ C?! at which J’, vanishes. It is obvious that if u is the Zariski closed 
set, in g, of all zE g at which J’S vanishes then u==u"(U) or 


(4.10.7) u= U P(é). 
feu 


To prove J’§ is a radical ideal it suffices to show that if f € S is assumed 
to vanish on u then f€J’S. By Theorem 11, §4.8, we can write f == > fiu 
where fE J, ME H and the h; are linearly independent. Let € U. Then 
since the fı reduce to constants on P(£) it follows from the isomorphism 
(4.8.6) and (3.8.7) that since f vanishes on P (£) the fi also vanish on P(£). 
Thus the f; are in J’ by the nullstellensatz and hence f€ J’S so that J’S is 
a radical ideal. 

Now let VE % so that JY is prime in J. Put J’—=J7 so that, from 
above, JUS is a radical ideal in S. To prove that JUS is prime it suffices 
now only to show that u is irreducible. 
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Let f€ 8 and let U(f) be the set of all &EEU such that f | P(€) is not. 
zero. Obviously f | u is not zero if and only if U(f) is not empty. We first 
show that in such a case U(f) contains a non-empty Zariski open subset of U. 
Indeed assume U(f) is not empty and £EU(f). Then f | O*(£) is not zero 
by (3.8.7). Hence there exists a€ G such that (a-f)| O*(€) Nb is not 
zero, by Theorem 8, 84.7, where p is defined as in (4.5.6). Thus (a-f)| b 
does not vanish on a Zariski subset of b containing O'(£) Mb. Using the 
isomorphism (4.7.8) it follows that U(a-f) contains a non-empty Zariski 
open subset of U. But clearly U(a-f) =U(f). Hence U(f) contains such 
a subset. : 

Now let fi€ 8, i= 1,2, be arbitrary except that fi | ur is not zero. To 
show u is irreducible we must show that fıf» | u is not zero. From above it 
follows that U(f;) contain a non-empty Zariski open subset of U. But since 
U is irreducible it follows that U(fi:) N U(f2) is not empty. But then 
fafa | P(&) is not zero in case €€ U (f1) N U (f2) since P(£) is irreducible by 
Theorem 3, §3.8. Thus u is irreducible and hence JUS is prime. 

The relation (4.10.1) is just (4.10.7). Furthermore if u=u(J¥8) 
then (4.10.3) follows from (3.8.4). 

Moreover, using (4.10.1), it is immediate that the map, given by 
(4.10.2), from U into the set of all Zariski closed G-stable subvarieties u of 
g such that uNr is not empty is injective. Now assume that u is such a 
subvariety. We will show that u.is in the image of the.map defined by 
(4.10.2). Let the set U CC! be defined by putting U=u(uNr). Since u 
is Zariski irreducible and u N r is Zariski dense in u it follows that U is 
Zariski irreducible. On the other hand by Theorem 8, 84.7, it is clear that 
U corresponds to u N p under the isomorphism (4.7.3). But since uN v is 
Zariski closed in b it follows that U is Zariski closed in C}. Hence Ọ € U. 
But U is Zariski dense in u(u). But this implies u(u) =U since U is Zariski 
closed. Thus uCu(U). But u*(U) is clearly in the Zariski closure of 
uMr since the relation (4.10.8) obviously holds. Thus u—w#(U) or 
u = u(J7§8). 

Now obviously (du;*)¢, i—=.1,2,- - -,1, are linearly independent at any 
point £EC!. Since (df), is in the span of the (du), for any feJandzeg 
it follows from Theorem 9, 84.7, that (df).—0 if and only if (df*)z—0 
for any f€J and zEr, where &=u(z). It follows in particular that if 
UEU and c€uNr where u—u(J7S) then the dimension rẹ of the space 
spanned the (df), for all f€ JU is the same as the dimension rg of the space 
spanned by all (df*)¢ where f€ JY and é= u(x). If +r is the codimension of 
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U in C! and U, is the set of simple points of U then by the Zariski criterion 
rer for all €€U and rg—r if and only if € U, Thus r,<r for all 
zeuNnrandrs—r if and only if u(z)€ U, Since unr is Zariski open 
in u and since JY generates the prime ideal of u then by applying the Zariski 
criterion to u one obtains (4.10.4) and the fact that z€ uN r is simple on u 
if and only if w(x) is simple on U. 

Finally let TE U have codimension r in.C!. Let a be an irreducible 
component of u N r° where u=u(JVS) and let Y CU be the Zariski closure 
of u(a). Let g= dim ¥ so that, obviously, gS}—r. But if p= dima then 
by Corollary 1, p. 109 in [3] there exists £€ Y such that (u | a) *(€)=P(é) Na 
has dimension p— q. Hence dim P(£)Na>p—I!--r. But by (3.8.5) one 
has dim P (£) Nr°Sn—I1—2 Thusn—22p+rorn—r=p+2. That 
is, by (4.10.4) dimu=dima+2. This proves (4.10.5). Q.E.D. 


Remark 23. By putting ug in (4.10.5) note that r° has a dimension 
. of at least 2 in g. On the other hand if q is the set of regular elements in g 
and v€ J is the invariant polynomial such that v | § is the product of all the 
roots (positive as well as negative, so that it is a Weyl group invariant) then 
the complement q° of g is the set of zeros of v and hence has codimension 
ling. 


5. The normality of the varieties P ($) and the generalized exponents. 
The following criterion for normality and its proof is due to Seidenberg. 


THEOREM 15 (Seidenberg). Let uCg be a Zariski closed subvartety 
of g. Assume (a) that u is a complete intersection and (b) the set of non- 
simple point of u has a codimension of at least two in u. Then u ts a normal 
variety. 


Proof. Let r= dimu. By [16], Theorem 3, one knows that u is normal 
if (1) u is free of (r—1)-dimensional singularities and (2), every principal 
ideal in the affine algebra of u is unmixed. Since assumption (1) is satisfied 
(statement (b) in Theorem) it suffices therefore only to show that if I (u) 
is the prime ideal, in 8, corresponding to u and f € 8 then the ideal (Z (u), f) 
is unmixed. Obviously one may assume that (I(u),f) has dimension r— 1. 
But then the result follows from Macaulay’s theorem (see [19], p. 203) since, 
by (a), one has that Z (u) == (fa * *, fur) for some € I (u). Q. E. D. 

Now if V is any finite dimensional G-module and z€ g is arbitrary 
consider VO” the subspace of vectors in V that are fixed under all elements 
of G*. We now find that the dimension of V@ is the multiplicity of the zero 

‘weight in V (and hence is the same) for all c€r. (This, incidentally is not 


p 
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necessarily true for the covering group of @). Obviously it is enough to show 
this for irreducible G-modules. 


THEOREM 16. Let £€ C be arbitrary. Then P(£) is a normal variety. 
That is, if zE r then Ö, ts a normal variety (see Theorem 4, 83.8). Further- 
more if R(O,) denotes the ring of everywhere defined functions on the orbit 
Os (R(O,) is isomorphic to R(G/G*)) then R(O,) is an affine algebra. 
(That is, it is finitely generated.) In fact R(O,) =8 (0a) where S(Oz) is 
the restriction of S to Oa so that tf E=u(r) then P(£) =O, is the affine 
variety of maximal ideals of R(Oz). l 

Moreover R(O,) is a completely reducible G-module and for any X€ D 
the multiplicity of vè in B(O,) is h, where I, is the multiplicity of the zero 
weight of n, (or equally of +>), so that R(O,), for all zer, are isomorphic 
as G-modules. Finally for any zer 


(5.1.1) dim V3” == ly 
where Vy and n is defined as in 82.1. 


‘Proof. By Theorem 10, § 4.8, P(£) is a complete intersection. Also by 
Theorem 10 the set of non-simple points of P(£) has a codimension of at least 
two in P(€). Hence P(é) is normal by Theorem 15. But now by Corollary 1, 
§ 3.8, the complement of Os in O, has a codimension of at least two in Ö, 
for any «€r. Hence R(O,) =8(0,) by Proposition 9, 82.2. But in any 
case 8(O,) is isomorphic to 8(Ö,). Since S(Ö,) =R(Ö,) (see (2.2.2)) 
it follows that every element of R(O,) extends uniquely to an element of 
R(Ö,). This induces an isomorphism 


(5.1.2) R(0.)> R(Ö.) 


so that R (Os) is an affine algebra. Obviously R(O,) is a completely reducible 
G-module. But by Theorem 11, 84.8, the multiplicity of A in 8(0,) is h. 
It follows therefore from Proposition 8, § 2.1, and the G-module isomorphism 
(2.2.1) that dim Va” =h. Q. E. D. 
Let zer. As a corollary of Theorem 16 we now observe that Ö, is dis- 
tinguished among all affine varieties into which Os may be embedded. 


CoROLLARY 8. Let sE r be arbitrary so that == u(z) € C! is arbitrary. 
If we identify G/G* with Os (using the isomorphism (1.2.2)) then any 
morphism of G/G@ into any affine variety X extends uniquely to a morphism 
of the affine variety P(£) into X. 

In particular any morphism of the orbit of principal nilpotent elements 
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into an affine variety X extends to a morphism of the variety of all nilpotent 
elements into X. 


Proof. Using the isomorphism (5.1.2) this result follows from Corollary 
1, p. 58 in [3]. Q. E. D. 

Remark 24. By Theorem 16 all R(O,) for z€ r, are isomorphic as G- 
modules. However it should be noted that they are not isomorphic as rings. 
Indeed the corresponding variety of maximal ideals of R(O,) is non-singular 
in case x is regular and, by Theorem 10, §4.8, is singular otherwise (for 
example, in case z is principal nilpotent). ` 

5.2. Now for any à € D consider Home (V>, 8) the space of all G-module 
maps y of V> into the ring of polynomials §. Obviously y(V*) C 8% for 
any such y. 

We now observe that any 2€-g induces a linear map 

ws: Home (V>, 8) > Vy? 
by the relation 
(5.2.1) <V, wey> — (y (v) ) (2) 
for all ve V and any y€ Homg(V4,8). Since y is a G-module map it 
follows immediately from (1.1.5) that for any a€ G 
(5.2.2) n (a)vs(y) = valy) 
and hence, obviously, ws (y) € Vx for any zeg. 

Now by Theorem 11,§ 4.8, the subspace Homg(V*,H) of Home (V>, 8) 
is of dimension 4. On the other hand, by (5.1.1), V, is also h-dimen- 
sional whenever z€ r. As a corollary of Theorem 16 we obtain 

COROLLARY 4. Let c€ rand let AED. Then the map 
(5.2.3) Home (V>, H) > Ve 
defined by restricting w» is an isomorphism. 

Proof. Since both sides of (5.2.3) are vector spaces of dimension J, 
it suffices to show (5.2.3) is a monomorphism. Let y be in the kernel of 
(5.2.3). Then, by (5.2.2), was(y)=0 for all ac G. Now let ve Vr 
Then, by (5.2.1), (y(v)) (ac) —0 for all a€ @. Thus y(v)|O,=0. But 


since (4.8.6) is an isomorphism it follows that y(v)—0 for all ve VA. 
Hence y==0, and consequently (5.2.3) is an isomorphism. Q.E.D. 


5.3. Now since ad maps g into the Lie algebra of @ it is clear that any 
finite dimensional representation 


v: Q> Aut V 
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of @ induces, by taking differentials, a representation of g, which we algo 
denote by v. Note that one always has v(3) = 0 where 3 is the center of g. 

Now let Z be the subgroup of h’ generated by the set of roots A. If 
o(p), the order of u, is defined by 


o (u) = [To p> 
for any »€Z it is then clear from (4.1.6) that o(y) is always an integer. 
Now since every weight of y is clearly necessarily an element of Z it follows 
therefore that 
V=> V® 


kez 

is a direct sum where V® is the eigenspace of v(z,) belonging to the eigen- 
value k. Obviously 

(5.3.1) v(g) V® C Veo, 


Now e- be the principal nilpotent element defined as in 84.2. For 
notational simplicity write F = V°*-. Since @*- is connected (Proposition 14, 
83.6) one also has 
(5. 3. 2) F == Ker v(g°-) 
and by (5.1.1) 

dim F=}, 


where J, is the dimension of the zero weight of v. 

Now since z, lies in the normalizer of g*- it follows from (5.3.2) that 
F is stable under »(z)). But then we observe that there exists a unique 
sequence of integers m,(v), 1=1,2,: - +, lp, where 


m,(v) S + S m (v) 
such that F has a basis 4%, i= 1,2, - -,1,, where 


(5.3.3) vy Vem), - 


Remark 25. By applying the inner automorphism which carries e, into 
e_ and To into — T, note that we would get the same integers m,(v) by using 
e, into instead of e_ and dropping the minus in (5.3.3). 

Observe then that the m;(v) generalizes the notion of exponents. Indeed 
if v is the adjoint representation then },—=1 and, by Theorem 5, § 4.4, 
m(v) = m; since F == g°.. 

Since FCKerv(e_) it follows from the representation theory of a 
three dimensional simple Lie algebra (e.g. see [13], §2.5) that for any ¢ 


(5.3.4) 0<m(a) 
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Now, as in Remark 22, § 4.8, identify D with the (subset of Z) set of 
all dominant integral (with respect to Œ) forms on § so that any AE D is 
the highest weight of »\. Note then that —A is the lowest weight of n. 

When V = P, and yv =n we will write Fy for F and m,(A) for mn). 
The m (A), i= 1,2, > -iy will be called the generalized exponents of g 
(corresponding to A). See Remark 25. 

Now let v€ V} be the lowest weight (—A) vector. Then since Vy, 
as one knows, is a cyclic module with respect to the universal enveloping 
algebra of m with v, as cyclic vector it follows that 
0 if k>o(A) 

(m) if k= o(a). 

Since VOV is obviously contained in Fy. (One uses the relation 
g°- Cm* + 3 mentioned in the proof of Theorem 5, §4.4). It follows then 
that 

(5.3.5) mi(A) < my (A) =0 (A) 


for 1Si<h. 


We 


5.4. LetAeED. For convenience we will write H(A) and S(A) for the 
subspaces HAC H and SACS respectively. See §2.1. Clearly H(A) and 
S (à) are graded subspaces. In particular then 


H(A) — SH)! 


On the other hand by Theorem 11, 84.8, the multiplicity of A in H is I. 
Hence one has a direct sum 


(5.4.1) H(A) m= Bd) 


where (1) H,(à) is an irreducible G-module, (2) H,(A) is a space of homo- 
geneous polynomials so that for some degree m(A) one has H,(A) C8 
where (3) we may assume the n,(A) are monotone non-decreasing with i. 

The integers m(A) are the degrees k such that yò occurs in H*. The 
question arises: how does one determine these integers? Since S(A) is 
obviously isomorphic to the tensor product J@ H(A) by Theorem 11, 84.8, 
it is clear that such information is needed if one is to determine the formal 
power series 


a(t) =J dim 8(a)*# 


and, as a consequence, the multiplicity of A in S* for any k. 
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The following theorem asserts that the n,(A) are exactly the generalized 
exponents m;(A). 

THEOREM 17. For any A€ D and i=1,2,- + +,h, one has m(A) = m(A) 
so that H,(A) CS™®. In particular k==0(A) is the mazimum degree such 
that H(X)*>£0. Furthermore H(A)* is irreducible for this value of k. 
That is, 

Hy (A) = H(A). 


Moreover the formal power series q(t) may be given by 


> EmA) 
(5.4.2) i q(t) = da E 
TI (1—t) 
4=1 

where dy, == dim V. 

Proof. Let v, i= 1,2, > +,h, be a basis of Fy such that v€ V Cm0), 
Now let c€ C* be arbitrary. Let re cC be such that e” == and let a€ G be 
defined by putting a—exprada. Itis then clear that — 


(5.4.3) n(a)v = mN, 
Also note that 
(5.4. 4) a(6_) = ce. 


Now by Corollary 14, § 5.2, there exists a basis y t= 1,2, +, ih, of 
Homg(¥*,H) such that 
we. (y1) = Ur 

But now by (5.4.4-5) and (5.2.2) one gets the equation 
(5.4.5) Nas (y) = Woe (y1). 

Substituting in (5.2.1) this implies that for any ve V* 
(1:(9) ) (ce) = Ny (v) (e). 
But then, conjugating by Œ (and using (1.1.5)) it also follows that 
yilo) (cy) = om, (v) (y) 


for all y€ O.. But then since (4.8.6) is an isomorphism for z= e. it 
follows easily by choosing c, for example, to be positive that 


aN TSN, 
On the other hand by definition of the y; 


HA) =P) 
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is a direct sum of irreducible G-modules. me uniqueness of the mad) it then 
follows that n(A) = m,(A) for sel, -,h. 

The second and third statements of the theorem. follow immediately from 
(5.3.5). The equation (5.4.2) is an immediate consequence of the obvious 
fact that the pl (4.8.4) induces an isomorphism of J® H(A) 
onto 8 (A). Q.E.D. 


Remark 26. We observe here that Theorem 17 is a generalization of 
Theorem 5, $4.4, asserting that m,(v) = m, where v is the adjoint repre- 
sentation. Indeed let U be the subspace of all we J* such that <d,u> —=0 
where de (J,*)?. It follows immediately that dim U —1 and that any homo- 
geneous basis of U is a set of primitive invariants wi=1,2,: ' ‚1. But if 
the u; are so chosen then by definition of U one has du, € J” == 8° (immediate 
from (1.1.2)) for any 6€ J,*. It follows immediately then that, for 111, 


(5.4.6) du € Hs for every sE g. 


(Recall that S, is commutative.) But now if g, is a simple component of g 
of rank 1, and w,, k==1,2,---,1,, are as in the proof of Theorem 9, 84.7, 
then one must have d,u,€ H (y) for any sE g, where y€ D is defined as in 
the proof of Theorem 9. See (4.7.8). (In particular note that if g is 
‚simple and zy is a basis of g then 


(5.4.7) Da, tm 1, + -,l, gl," ‚nis a basis of H (y) 


where y is the highest root of g). It follows immediately that ny, (y) = Mmi. 
Applying Theorem 17 one then obtains ma (y) == m, which immediately yields 
m;(v) == my. 

It should also be observed then that the A o (à) == my (à) generalizes 
the well known relation o(y) =m, See Corollary 8.6 and Lemma 9.1 
in [13]. 


Remark 2%. Note that the argument given in the proof of Theorem 17 
may be reversed. That is, if L is an arbitrary irreducible G-submodule of 
H(A) and y€ Homg(V*, H) is such that 


then for any integer j = 0 one has 
(5.4.9) LCS! if and only if we (y) € Vac. 


Indeed if LC 8, then by (5.2.1), wos (y) = dwe (y) for any ce C*. But 
then if a€ G is defined as in the proof of Theorem 17 one obviously has 
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wa (y) € VC) since m(a)oc(y) clon (y), by (5.4.4) and (5.2.2) and 

c€C* is arbitrary. The argument for the other direction has been given 

in the proof of Theorem 17. - l i 
For any A€ D let yò € Home (V^, H), t= 1,2, + -, be fixed so that 

yè (V>) —H,(A). Obviously the y; are a basis of Home (V>, H) by (5.4.1). 
Thet argument in Remark 27 may be used to yield 


Turormm 18. Let c€randacG. Assume a(z) = cr for some cE CH, 
Now let AE D. Then the I-dimensional (by 5.1.1)) space V°” ts stable. 
under »,(a). Furthermore for t=1,2,---,h, 


{cm} are the eigenvalues of (a) | Vı@* 
and we(yA) is a corresponding basis of eigenvectors. 


Proof. Since H,(A) C 8S™® by Theorem 17 it follows from (5.2.1) that 
woa (yè) =o" Vog(y). But then n(a)us(yA) = o%ug(y) by (5.2.2). 
On the other hand by Corollary 4, 85.2, the ws(+;*) are a basis of V,%. 
E Q. E. D. 


5.5. Let V be a finite dimensional G-module with respect to a repre- 
. sentation y. Let A C G be the Cartan subgroup of @ corresponding to § so 
that V4 is the zero weight space. We recall that W is the Weyl group of G 
corresponding to 5. Now since V4 is obviously stable under the normalizer of 
A in G it follows that v induces a representation 


a: W— Aut V4 


of the Weyl group. W on V4. One notes that this is a generalization of the 
usual representation of W on h (case where v is the adjoint representation). 
_ When Y = V, and yy we will write m for r. 

Now assume in the remainder of this section that g is a non-trivial 
simple Lie algebra. Let y € D be the highest root of g so that is the adjoint 
representation. Let 

s—=1+40(y) 


or equivalently let s—-1-+m; See end of Remark 26, 85.4. 

We recall that an element o € W is called a Coxeter-Killing transforma- 
mation in [13], § 8.1, if it can be expressed as the product of the reflections 
defined by the simple roots (in any order) relative to any system of positive 
roots, 
Let o€ W be a Coxeter-Killing transformation. It was observed empiri- 
‘cally by Coxeter and then proved independently by Steinberg and in [13] 
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that the order of o is s. It was also observed empirically by Coxeter and 
proved in [4] that the eigenvalues of ry(c) are ertmil®, j= 1,2, ° ,l. We 
will now generalize this for all A€ D. 

By a theorem of Coleman (see [4]) there exists a regular element z€ } 
such that 


(5.5.1) o(2) = eisg, 
In fact, by Corollary 9.2 in [18], z is a cyclic element of g. 


THEOREM 19. Let c€ W be a Coxeter-Killing transformation and let 
NE D be arbitrary. Then the eigenvalues of m(o) are tm Ol fom 1,2,- Ty, 
and tf z€ his the cyclic element satisfying (5.5.1) then {we(y:)} is a corres- 
ponding basis of eigenvectors. 


Proof. Let a€ G be any element of the normalizer of A which defines 
ac W so that n(a)| Vi4==m(c). Since a(z)—cz where c= °t the 
result follows immediately from Theorem 18 since by Coleman’s theorem z is 
regular and hence z€ r. Q.E.D. 


Remark 28. If g is the three dimensional simple Lie algebra we may 
identify D with the set of non-negative integers where dim RA + 1. 
Here —=1 for all AC D and m,(A) =A by (5.3.5) since o(A) =A. Also 
obviously s—:2. Note then that one recovers from Theorem 19 the well 
known fact that m (e) = (—1)X for ce W, c1. 


Remark 29. For any keZ let [k] denote its canonical image in 
Z,==Z/sZ and for any m€ Z let n(m) be the number of integers 1 SiS h 
such that [m;(à)] = [m]. Now if oe W is a Coxeter-Killing transformation 
and keZ is prime to s then o* is again a Coxeter-Killing transformation 
by Corollary 9.2 in [13] (using (5.5.1)). It follows easily therefore from 
Theorem 19 that n(m) —1,(km) for any integer m. Note that this generalizes 
Chevalley’s observation that m; + Mums since we may put k==—1 and 

one knows m, < s. 


6. A decomposition theorem for the universal enveloping algebra U 
of g. 1. Let T be the tensor algebra over g. Then one knows that in a 
unique way T is a G-module so that G operates as a group of algebra auto- 
morphisms extending the action of GŒ on g. 

Let QC T denote the G-submodule of all symmetric tensors in T. 

Also for r = 0,1 let I, be the ideal in T generated by all 


(c@y—y@z) — rl2,y] 
where 2,y€ g. Then since I, is G-stable the algebra T,—T/I, is a G-module 
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and one knows that the canonical epimorphism T—T, induces a G-module 
isomorphism To 
8: Q> Tr. 


However, by definition the G-module T, is the symmetric algebra 3, with the 
G-module structure of §1.1 and the G-module T, is the universal enveloping 
algebra U of g with G operating by the usual extension of the adjoint repre- 
sentation. Now if 8, 81080" then obviously 

84: S> U 


is a G-module isomorphism and that furthermore since Q is the subspace of T 
generated by all tensors of the form z8: - -@a where sE g it follows that 
8, ((85)*) == 2* for any zE g. Finally then if we compose 8, with the inverse 
of B (see §1.4) one obtains a G-module isomorphism 


8: SoU 
such that, for any integer k = 0, 
(6.1.1) &(g*) = (8(g))* 


for every g€ St. Furthermore, one knows, by the theorem of Birkhoff-Witt 
that the filtration of U defined by the G-submodules 


U,—8( 38") 
+0 
is such that 
(6.1.2) 8(fg) =3(f)8(g) mod Days 


for (not necessarily homogeneous) polynomials f and g where degf <i and 
deg gj. In particular (6.1.2) implies 
(6.1.3) UU C Ung 

Now let ZCU be the center of U. By a theorem of Chevalley one 
knows that Z, like J, is isomorphic to a polynomial ring in } generators. 
Furthermore since Z is clearly the subalgebra of fixed elements under the 
action of G on U and since 8 is a G-module isomorphism it follows that 
(6.1.5) 3(J) =Z. 

We now introduce a G-submodule E of U by letting E be the subspace 
spanned by all elements of the form 2*, k— 0,1, - +, where ze g is nilpotent. 

Remark 30. Note that the universal enveloping algebra U(m) of m is 
contained in # and (since every nilpotent element is conjugate to an element 
in m) that in fact Æ is the subspace of U spanned by all the algebras {U (1) } 
where m’ runs through all the Lie subalgebras of g conjugate to m. 
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THEOREM 20. One has 
è&(H) =E 
where, we recall, H is the space of all G-harmonic polynomials on g. 

Proof. Obviously §(P’) <P where P is the set of all nilpotent elements 
in g and P’ is defined as in 81.4. But since H — Hp by (4.8.3) the thecrem 
follows immediately from (6.1.1). Q. E. D. 

The filtration on Ọ induces a filtration on E where E =E N Up 

Now regard U as a Z-module (with respect to multiplication). The 
following is our main result on the structure of U. 


THEOREM 21. Let U be the universal enveloping algebra of a reductive 
Lie algebra g. Let Z be the center of U. Then U is free as a module over Z. 
In fact tf E is the G-submodule of U defined above (see Remark 30) then the 
map 
(6.1.6) ZBOE>U 


given by p®q> pq ts a G-module isomorphism. 

Furthermore for any AE D the multiplicity of the irreducible represen- 
tation „X in E is h, (the multiplicity of the zero weight for A). Moreover 
the order o(X) of A (see § 5.3) is the smallest integer k such that the multi- 
plieity of Wis Hy ish. 

Proof. Let £ denote the (G-module) map (6.1.6). To show first that 
B is surjective assume inductively that U, G Im £ (obviously U, C Im £ since 
U.a C E) for some integer j. Let re Uj. Then r= (g) where, by Theorem 
11, §4.8, 

g= È fiu 
with f€ J, h€ H and deg f; -+ deglu j +1. But then 
r= B (Z E(f) D8 u)) mod V; 
by (6.1.2). We have, of course, used (6.1.5) and Theorem 20. But since 
U,C Im it follows that r€ Im £. Hence £ is surjective. 
Now let p€ Z@H where p40. Then p is the image of an element 


e€ JH under the isomorphism J $ H—>Z®E induced by 8 (using (6.1.5) 
and Theorem 20). Furthermore we may assume that e= > fii® hy where 


i 
03>£fi€J and the h; are homogeneous and linearly independent in H. 
Now let k == max (deg fi + deg hu). It follows therefore by Theorem 11, 
i 


84.8, that if g = X fiu then g 340 and degg =k. Hence 
4 
(6.1.7) 8(g) 40 mod Ura. 
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But now p=28(h) SE): Thus 8(p) =Z (f) (u). But by (6.1.2) 
one has 
(6.1.8) 8(g) == 8(p) mod Ura 


Thus 8(p) <0 by (6.1.7-8) and hence £ is an isomorphism. The remaining 
statements of the theorem follow immediately from Theorems 11, 17 and 20. 
i Q. E. D. 


6.2. Let G, be any algebraic reductive group whose Lie algebra is g. 
If 
(6.2.1) vi Gy Aut Y 


is a representation of G, on a finite dimensional space V then the corres- 
ponding representation of g and U on V will also be denoted by v. 

An element a € G is called unipotent if a is of the form a = exp s where 
x € g is nilpotent. 


Lumma 16. Let v be as in (6.2.1) and let WCEndV be the space 
spanned by all operators on V of the form v(a) where ae G, is unipotent. 
Then W=v(E). 


Proof. By definition of # and the exponential formula it is obvious that 
WCv(#). On the other hand if z is nilpotent then v(exp ts) € W for all 
real numbers ¢. But, clearly, W also contains all ¢-derivatives of v(exp tz). 
Hence v(a2*) € W for k—=0,1,---. Thus o(#) CW. Q. E. D. 

As a corollary of Theorem 21, 86.1, we obtain 


THEOREM 22. Assume v (as in (6.2.1)) is irreducible. Then 
(6. 2. 2) v(#) = End V 


or equivalently (by Lemma 16), every operator b on V may be put in the 
form 


(6.2.3) l b= 3 op (as) 
1 


where the & are complex scalars and the a, are unipotent elements of Gu. 
Proof. Since v is irreducible one has y(Y) ==-EndV and v(Z)=C. 
The equation (6.2.2) then follows from the fact that (6.1.6) is an iso- 
morphism. The second form of it follows from Lemma 16. Q. E. D. 
_ Now let D,, V£ and n£, for ¢€ D,, play the same role for G, as the 
‘corresponding notation without the subscript 1 plays for G. (See 82.1 and 
Remark 22, § 4.8). 
Now End V, is a G,-module with respect to the tensor product of y, 
with the representation of G, contragradient to v,£. But since the center of 
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G, obviously operates trivially on End V€ it follows that End Vi‘ is a G- 
module and in fact the homomorphism of U onto End V, induced by v. is a 
G-module epimorphism. Since all modules under consideration are completely 
reducible it follows therefore by Theorem 21, 86.1, that vê induces a G- 
module epimorphism f 

(6.2.4) EX (End V,‘)* 

for every A€ D. 

Since every representation of G induces a representation of G, it is clear 
that DC D,. One defines a partial ordering on D, by putting 2%, for 
é £ € Dı, whenever £—£€ D,. It is easy to see that D, is a directed set 
with respect to this ordering. (“Sufficiently large” will mean all € D, such 
that = € for some & € D,.) i 


Lemma 17. For any €€ D, and X€ D let m (E) denote the multiplicity 
of ò in End V.E (regarded as a G-module). Then 
(6. 2. 5) m(é) Sh 
and (for fixed X) the equality holds for & sufficiently large. l 

Proof. Since (6.2.4) is an epimorphism the inequality (6.2.5) is an 
immediate consequence of Theorem 21, §6.1. However a much simpler and 
more direct proof of the inequality may be given using $4.1 in [12]. 

Now identifying V,'.@V,¢ with End V, and regarding G-modules as 
G,-modules it follows immediately from Schur’s lemma, upon forming the 
triple tensor product V, @V,§@ Fig, that nı(£) is also the multiplicity of 
nê in n8 nÉ. 

We refer now to [12], § 4.4, for the definition as to when A is totally 
subordinate to é By Theorem 5.1, (8) in [12] A is totally subordinate to £ 
for é sufficiently large. But now by (6) in this theorem (where p= 0, As == À, 
Ai ==€) the multiplicity of v. in n ® v. is h whenever A is totally subordinate 
to é Hence m (é) =h whenever à is totally subordinate to € or when £ is 
sufficiently large. Q. E. D. 

Harish-Chandra proved in [8] that if YC U is any one-dimensional 
subspace there exists £€ D, such that »,§ is faithful on Y. This is not true 
in general for higher dimensional subspaces. For example if p€ Z and q€ U 
where gx£0 and pé U, then g and pq span a two dimensional space in U 
but its image under »,*, for any € D,, is at most a one dimensional space. 
We now observe, however, that the generalization is true provided that Y G E. 


Tarorem 23. Let YC E be any finite dimensional subspace. Then the 
irreducible representation v£ ts faithful on Y for all £€ D, sufficiently large. 


Proof. Since Y is finite dimensional there exists k such that Y C Fy. 
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Now let CGD denote the set of all A€ D such that > occurs with positive 
multiplicity in Ex. Since F is finite dimensional it is obvious that C is a 
finite set. Now since D, is a directed set it follows that equality holds in 
(6.2.5) for all A€ C and all € sufficiently large. But then by Theorem 21, 
86.1, the map (6.2.4) is an isomorphism also for all ACC and €€ D, 
sufficiently large. Thus nê is faithful on H, and hence on F for all € 
sufficiently large. Q. E. D. 
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SOME DISTORTION THEOREMS OF QUASI-ANALYTIC 
MAPPINGS IN THE SPACE OF TWO COMPLEX 
VARIABLES.* + 


By STEFAN BERGMAN. 


1. Introduction. In the theory of schlicht conformal mappings, often 
starting from some basic properties of these mappings and using additional 
considerations, we derive various distortion theorems. 

Let ds(z) denote the length of the line element, da(z) the area element 
in the z-plane. If 


(1) z* == 2*(z) 


is a conformal transformation, then 


: (2) (28) 

“ \ds(2*) da(2*) P 
where ds(z*) and da(z*) are the corresponding quantities after the trans- 
formation. 

Relation (2) can easily be generalized to the case of a large class of 
quasi-conformal transformations, namely the class of the mappings by a pair 
(u(z,y),v(z,y)) of differentiable functions which satisfy the generalized 
Cauchy-Riemann equations. 








(3) Cu, + vs = 0, Cus — vy = 0, 0<0 <0, 


where C =C (x,y) is a continuously differentiable function. Mappings of 
this kind were introduced independently by Bers and Gelbart [B.G.1], 
[B.G.2] and by the author [B.4]. They were extensively studied and 
generalized by Bers [B.12] through [B.16]. 

In the case of transformations by a pair of functions satisfying (3), it 
holds 
fu, v) 
= Te) 


from which the generalization of the relation (2) can be obtained. Using a 





= C (u? a Uy?) = 5 (v? + v) 


* Received March 15, 1963. 
1 This work was suported in part by the National Science Foundation Grant Number 
21344 at Stanford University. 
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similar technique as in the case of conformal mappings, one obtains various 
distortion theorems for mappings by a pair of functions satisfying system (3).* 

Generalizing the latter transformation, one introduces mappings of the 
domains of the (four-dimensional) 21, Yı, Ta, Ys-space by four functions Uy V, 
Us, Va connected by system (2.1),? see p. 407. Mappings of this kind represent 
a generalization of pseudo-conformal transformations (PCT), they represent 
a subclass of quasi-pseudo-conformal transformations (QPCT).* 

One shows that in the case of these mappings the relation (2.6), a 
generalization of (4), holds, and an analogue of (2) can be obtained if we 
replace the length (ds) of a line element by the so-called B-area of the surface 
element and the area element da by the volume element. Concerning the 
B-area compare Remark 1.1. 

In the present paper we show that some of the consequences, analogous 
to those obtained by Ahlfors (for schlicht quasi-conformal mappings), can be 
made in the case of schlicht QPCT’s. They follow from relations (2.6) and. 
lead in this case to distortion theorems in the theory of ae whose com- 
ponents satisfy relations (2.1). 

This generalization is not immediate since the E in the case- of 
four-dimensional space is different from that of two-dimensional space. One 
of the difficulties which arises in these considerations is connected with the 
fact that the B-area of a surface has features different from those of the 
usual area, e.g., if a surface is analytic in the sense of the theory of two 
variables, then its B-area vanishes. 


Remark 1.1. Let a surface ©? be covered by a coordinate net. If we 
denote by ds,, ds, the line elements taken in the direction of the coordinate net, 
_ then the element of ©? equals. ds,ds,sin æ, where a is the angle between ds, 
and ds, The element of the B-area equals ds,ds, sin 8, where £ is the ‘analytic 
angle between ds, and ds, (see [B.3], p. 476, and [B.9]). If ds, lies in the 
analytic plane az, +- b®z, = Cr, then - 

(6) Jab — aH) | 
ME Ta TSF) (Ta P+ TEST 
(see [B.9], pp. 10-11). 
Remark 1.2. In addition to the procedure based on the relation (2.6) 





* Concerning the literature about distortion theorems in quasi-conformal mappings 
see, e, g, [K. 1]. 

è (2.1) = (1) of §2. 

* The theory of QPCT’s is connected with the theory of the so-called functions of 
the extended class. Various types of functions of the extended class have been considered 
by Bremermann [B. 17], Lowdenslager [L. 3] and the author [B. 5]. 
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z 


and used in the present paper, one obtains for PCT’s distortion theorems 
exploiting the connection between the kernel function and certain minimum 
problems, see [B. 2]. 


Remark 1.3. Using the theory of the kernel function, one can define 
an abstract manifold which is invariant with respect to PC'T’s (the so-called 
space of the class of pseudo-conformally equivalent domains (see [B.6], 

. p. 33)). The question how the invariants (curvature, etc.) of the basic space 
change if we apply a QPCT is studied in [B.11]. 

Domains in the space of two complex variables have distinguished boun- 
dary sets, e.g., an analytic polyhedron has the distinguished boundary surface 
(see [B.3]). In the case of PCTs regular at the boundary, these dis- 
tinguished sets (invariant in QPCT’s) will be discussed in a future publication. 


Remark 1.4. Distortion theorems for mappings by solutions of systems 
of differential equations more general than (3) are discussed in [L.1] and 
[L. 2]. 4 


2 A property of schlicht quasi-pseudo-conformal transformations. 
Let Op=Op (2, 41,22, Y2), u= 1,2, be continuously differentiable positive 
functions 21, Yı, Ta, Ye defined in a (bounded) domain D of 24, Yı, T2, Ye-space. 
Further let Ur, Ur, Ue = te (Lr, Yr, To Yo), Wed (En Yo Ta, Ya), b= 1,2, 
(21, Y1; T2, Y2) € D, be four continuously differentiable functions which satisfy 
the system 


(1) peed Pea Caz 5-5 k=1,2, p=1,2. 
OYn i 


A one-to-one mapping W of the domain D by the functions wy, Vi, Us, Ve 
satisfying the relation (1) is a QPOT of ®. 
Let ©, © C D, be a segment of the surface 


(2) . % == TĦ = const. Ta == T,* == const, 


and let 2? — W (©?) be the image of ©? in the th, 7%, Us, Ve-Bpace. 


In addition to the area of a surface element we can consider the so- 
called B-area® of the element of ©, given by 


B) dB (St) — dy.dy.. 
* Concerning the notion of the B-area see [B. 3], pp. 475 ff. 
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THEOREM 1.° . The B-area dB (F?) of the surface element of Z — wis 
18 given by 


8 (Ur, V1, Ue. Sa Pe tata) 
4 dB(Z?) = | 0, 10,7 I dy,d 
( ) ) [ a 5 Ren Yı, Ta, Y2) F = y 
Proof. According to the definition (see [B.3], p. 475) 
2 9( wi, | 
5 ; dB = |->] dyd 
( ) l (Z*) |? ay: Ya) ue Ya 


Wy == Wy (21,2) = Uy (Lr, Yay Lay Y2) + Wy ( Li, Yr, Ta, Ya). 


We shall show that 











I(T, 2) = = 8 (11, v1, Us, V2) a 

6)- =| 0,20, f 

( ) d(yı,Yz) (c Cs er) 

A formal compütation shows that i 
Bu, Du; Dun Bos 
Oa, da, dx, Oa, 

(7) i int ia in oc f — o F(t, Ya) 9 (ua va) ð (v1, va) J7 

DO Seah ears (YoY) (Yr, ¥2) | LIY 92) 

ee (1, ta) ) A(t tn) 
Oa, 0% 02, Oa, Vi, Ue Un, Ve Un Us l. 
Du, Bu, Otis dv, + en] rd 
dys öys dye Öys 


On the other hand, 


(8) 8 (ty Hiva the + ive) | 








— [eee Cees + pesa 





(Ya Ya) ô (Yn Ya) ô (Y1 Y2) d(Yı, Ya) 
ts Ô (V1, te) —g A(t, (Ua, te) d(v,, V2) 
(41; Y2) ay, (Yo Ye) 9 (Ya Y2) 





+ 2 (th, Va) 3 (v, tuz) 


B(Y:, 92) Y 92)” 
and 


(9) O (tl; tz) (Vr Va) A(t, V) O(Vi Ua) A(t, 21) | O(t Va) 
(YY) PCY Ye) (Y1, Y2) (Yn Y) (Ys, Y2) (Ys, Ya) 


(6) follows from (7), (8) and (9). 





* See also [B. 10], p. 137. 
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.8. A generalization of an Ahlfors result to the case of two complex 
variables, In the case of one variable, Ahlfors [A.1], [N.1], p. 87, con- 
siders a curved linear strip ®* in the z,y-plane. This strip is mapped by 
the function w(z) =u(z,y) +iv(z,y) conformally and schlicht onto a strip 
bounded by lines v—=-a/2 and v—-—a/2 in the u,v-plane. He then 
obtains the inequality. 


(1) of wor S ADE SA Salula) u (0) 


Here A is the area of the image of B? in the u, v-plane (see for details [A.1] 
or [N.1], p. 88 £.), 
th(2)— min u(zy), (2) = max u(z,y), 
y EQ (o) - yc D(a) 
w(t) =u: (7) — u (2), 


(z,0) € Ot (z), D!(z*), is the connected part of the intersection of the strip 
with the line z= z*, 1(Q1(x*)) =the length of Q'(z*). In the present 
paper we generalize Ahlfors considerations to the case of QPCT’s, whose 
components satisfy (2.1). 

We consider in the 2, y1, T2, ¥2-space the domain D bounded by segments 
of four hypersurfaces 


(2a) Y1 = fı (Ta, Ta, 42), Sy S w an = ün (T1, T2), 

(2b) Y1 = fa (Ta, Ta, Y2), WSnSat, On” = ln? (Ta, T3), 
n —3, 4, 5, 6, 

(8a) Y: = Ge (2, Ta, 41), as s Yı s Ae, 

(3b) Y2 = Je (Tu Ta Y1)» ast S yı S t". 


Gx (Li, La, Ys) Gu (Zi, Ta, Yee), k= 1,2, are assumed to be single-valued con- 
tinuously differtiable functions of (T, £e, Yax) and the segments (2a), (2b), 
as well as (8a), (8b), do not intersect each other. 


Remark 3.1. Here as, as”, Qu, a4*, Gs, Os*, Qe, Qs* are conveniently chosen 
quantities. We note that these quantities are connected by the relations 
dz = fja (ds), dy = ¥2(as*), G2 (as) = G2 (Gs, Tı, C2) 
Qs == Jı (Qa), as — J, (04), ; 
del), mat), 
ao* = (ur), Gr Tat) 
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We construct in the th, Vi Uz v.-space the domain A* whose boundary 
consists of segments of hypersurfaces 


(48) l v =— 4,/2 ~ (5a) Vg == — Ay /2 
(4b) Vy == 4,/2 (5b) Ve == 3/2 


and we assume that the schlicht (one-to-one) QPCT 


(6) W: Wy = W1 (41, 2), Wa m Wa (21, 23) 
Yz as) 
# a C(ys—= ae", ya—a4*) 


yo aly) 


Gays) dl) 





D (yY, = Gg, Ya = 45") 





Alyı = üs, Y¥2—= s) 
Yı 





Figure 1. The Domain Q? (z,, ze). 


maps the domain D onto a domain Y which is a part of M*. Let O7(2,*, 2,*) 
be a connected segment representing the part of 


(7) (at) = DN (21 = 2,*, Ta = Ta”) 


which includes the points y, = 0, y, = 0 in its interior. For simplicity’s sake we 
assume that Q(t, 22) = 67(21, T2), TKO Sm S a, b= 1,2. Dar, 2*) 
is bounded by four curvilinear line segments t,?, 1,1, tet, tt. Here 


(8a) tt? ta") — [21 ent, Ta = oa, Y1 = Hr? Da, Y2); Yo € Pi (au, 22), 
pi" (2,*,%*) is the projection of 4,*(z,*,2,*) on the segment , <y.=Sa, of 
the y,-axis. Analogously, 
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(8b) 121, 2”) = [21 = mt, Ta nt, Y1 = Fa (TŽ, a*, Yo), Ya E Dat(aı*, 22*)] 
(8c) t3!(aı*, to") = [ay = T, Da m To, Ya = Ga(T1*, Lat, Y1), Ya € Pa (Tt, Ta*)] 
(ed) War, 22*) = [ty = nt, Ba = Ta, Ya — Dal T", Ta*, Yr), Ya E P(T, Ta”) ]. 
We assume that the domain D and the functions w,, w, are chosen so that 
Im[w, (a1*, £2”, 9. (Y2); ya) | = — 01/2 = const. 
Im[ (21%, 23%, 9s (93), Ya) ] = 0/2 — const. 
Im[w; (z1*, 22", 41, je (Y1) ) | = — a2/2 == const. 
Im [w; (21%, 23*, Y1 Jo (ys) ) | = 0/2 — const. 
The image W (O? (T1, £2) ) of 0?(a1,2_) in the w,, we-space will be called 


(9) 


er 4 
Q (2,2%) = Q (us, V1, Ue, V2), its boundary (the image of (J t» (£1 £2)) will 
yal 
be called I (a, 22). 


The one-parameter family 


(10) P) = U 2a) 

is a segment of a hypersurface. Its boundary is 

(14) lm) = bi 

Since Ww, W, are continuous functions, 

(12) Hm UE im) =, UU Pam) 
zo wen 


Since the mapping W is one-to-one, 
(13) R (21,22) N R (2, 20) =Ø if (21,42) A (t1*, 2#). 


Indeed, if the left-hand side of (13) were not empty to the intersection point 
of X (x1, £2) and 27(a,*,2,*) would correspond to two different points (#1, 22) 
and (#,*,%.*), this is impossible since the mapping W is one-to-one. 

Let 





Qa 
(14) b (ur, V1, Us, V2) ag gB [$ (th; Vay Un va) | 
dA[X? (th, Vi, Ua, V2) ] 
be the ratio between the B- and the ordinary area of the surface element of 
g? (a1, Ze) . 


Further, let dp, (t, 01, Us, V2), v = 1, 2, 8, 4, 5, 6, the the Euclidean areas 
of the projection of the surface element of Q(z, 22) == W (Q (t1, £2) ) 
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ja: . Domain ® jus Domain Wf 

us yı % a MAJA 
Tı u 

2,0) u Ze 


T) u, 


S 


u, 





/ 


2,9) 


> Sees oe 


Fig. 2. Intersections of D with Fig. 3. Intersections of W with 
Ta = T”) — const. Uz = Uz”) == const. 
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on the 4,01, Ur Ua, Us, Ua, U1, Ua, V1, Vz- and %,,v,-planes, respectively. — 
P [Q (a, v2) ], v= 1, 2, 8, 4, 5, 6, are the projection of Q (z1, 72) on the before 
mentioned planes. We note that 


6 
[dA [23 (u, V1; Ua, 2) ] r = 2 [dp,(t, Vi, Ua, v) 15 
(15) Ur + Wy mm Ur(21,22) + Wel 23), 
(in, Vis Us, vs) € (a, T2) : 
Trrorem 2. Let W be a schlicht QPCT of D onto the domain A, 
satisfying the conditions (9). Then 


1 g a R Tbn (iy 2) B [Q (ey 2) 1]? 





Sn dz 
TER AlO (2,,2)] ee 
a yc 
> : i g 
(16) = U (1/0) [md — m, ®], 
16 Q, in) = C 
( a) k ao i AET Yı, Za, Ya). 
Here 
f m m, = max[u,(z,, Yı, Ta, Y2)]; (41, 42) € Vz, ts), nOs bs = Ta 
m © = min [1 (a, Yo TaY ) 1, (Ys, 92) € DT, la), u) S ba Sa 
(18) mo) — max[us(2ı, Yı, Lay Ya) ], (91, Y2) E OC; He), 9 Sf, Sa, 


m.) = min[u.(z,, Yi Ta, %:)], (Yi Ya) € DL, x), TOSARA 
(19) bn( 21, Ta) TEA min[b(u, V1, Us, va) I, (us V1, Ua; vs) € (a, Ta). 


Proof. By the Schwarz Poen 


o [SSEB wen] = ff oom se 


P( 212) 








dyıdya 


. or 


(21) [BIS SIT J Siege | dy dys. 


ALO? (21, Ze) | ö(y1, Ye) 





Multiplying both sides of (21) by dz,.dz,, integrating over [TO Sa, Sa, 
k==1,2] and using (2.6) and (16a), we obtain 





(yf el dride = (1/00) VA) 


oy ag? 
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where V(&) is the volume of the domain covered by 27(21, £2), & Sm Sao, 
k=1,2. In accordance with (17), (18), since the mapping is schlicht, 
2 2 j 
(23) va) STL a (ma — mr) 
ist 
According to (14) and (15), 
GB (Q (a1, £a) ) == b (ua, V1, Uz, V2) GA (QL (T1, Ta) ) 


1 6 
(24) > —=b (th Va, Us, V2) Dı dp, (thay Va; Ua, Ve) 
. v6 g 7-1 


Ur = Ur (21,2), Ve = Vr (Zi 22), k= 1,2, (Ur V1, Ue, Va) E Q (T1, T3). 


We note from (15) it follows that 


6 


1 
(25) dA (th, Vi, Ua, v2) ST 2 b(t, Vis Us, Va) dp, (th, Vi, % Va). 


61 


From (22), (23), (24) follows that the left-hand side of (22) is larger than 


2 
Tes B So Uy, Vi, Us, 02) dP, (us, 0,401) | 

26 ff Luror) Baya) PEP o e 

= agar ATQ? (a1, 22) ] antes 
PEN : 


Pag 
S) J bmn (2a 2a) A [B, (8 (ty we) u 
= Sf ATO(a,e)) Bl 


(16) follows from (22), (23) and 26). 

We make now the hypothesis that the function b„(z,2,), see (19), has 
a positive lower bound, namely 
(27) 0 < BS bm (24, T3). 
Let f 

Prun (La, 22) = P [2 (t 22)] = Br", Purot 23) = Pe [L (2, 22) ] = Be? 

(28) Pan? 2) = Pa [R(E 22) ] = Bs?, Pum(2ı, T2) = Pla, 2)] = BY? 

Boyes (i, 2) = Pla, 21) ] = Bi, Brul Tr 22) — Po [L2 22) ] = Po? 


be the projections of &° (z, T7) on the corresponding plane. 
Let 
29 Tı) = max u 5 — i : 
(29)  wx(@1 Ta) Se zT (Lr, Yr, Ta, Ya)] nl Yas 2 Ya) ] 


LEMMA. (21,22) is the length of the projection of 2?(a,22) on the 
Uy Arts. 
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Proof. Suppose that a point u, - 
30 i „€ ug max tx (215 Yi T 
( ) st aG 2 Yo) | < Uy al #( 1» Yı, Va, Ys) | 
does not belong to the projection of 2?(z,,2,) on the U,-axis. This would 
mean that the hyperplane up = u," would divide 2?(21,¢2) into two dis- 
connected parts. This is impossible since 0?(2,,2,) is connected and the 
mapping W is continuous and one-to-one. 


Notation. O(2;,22) is the area of the projection of Q(T, e) on the 
th, U,-plane. - : vape 


THEOREM 2. If the bm(£ı, £2) satisfy the condition (27), then (16) in 
Theorem 1 can be replaced by 





g Ta + da?) (w,?(21,2 ) + 02?(21, 23)) + 0202? + O(a, Ze) | | 
en et A[D°(z1,22)] ne 
w DaD 


3 
S J (VW) [m — mr 9]. 
k 
Proof. According to the lemma and (28) 
AR’. (21, 23) ] = aros (21,22), k=1,2, s=1,2, 
A [Puu (21, %2) ] =Q (21, 22), AP’ (Ti 22) ] = tta, 


and therefore 


(82) 


o, bia, 2) ACB He, 2))]) 
z a S. A[O*(a,, ¢2)] Geis 


(33) 





>g f f (a1? + a?) (0? (£1, £2) + w3? (21, 22)) + 0’? + Q? (T1, T2) 


Alae, t] deit 


wD wD 

Our considerations yield further bounds for the sum of the squares of 
some projection areas. These bounds do not depend on the function b, see 
(14), but they involve the quantity 8” to be described in the following. 

In every O° (T, T2), %1, Ta fixed, ur (21, Yı Tas Yo), Vi (21, Yr, Ve, Yo), k—1,2 
are functions of yı, yz. The pair uz, Vk, k=1 or 2 defines a mapping M, of 
the segment 07(21,22) on a domain of the uz, ve-plane. Since the functions 
Uz, Vy are continuously differentiable in Q? (t1, 22), 


8 (uz, UE) 


(34) (gaya) | Pet Yo ta 9s) | 
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is uniformly bounded in (closed) 0?(2,22), PrO S tr S T, k= 1,2. 
(| Di(¥:, y2)| is the distortion of the area element at the point yı, Ys of 
Q’ (T1, z2) when applying the transformation Mz.) 


Let 
2 
(35) i (max) = Max | II Dy (2, Yi Te, Ya) | < Oo. 





Here the maximum is taken for 
(Ys, Y2) E Q? (Tr, Ta), SHE. 
THEOREM 3. Let the QPCT (6), satisfying the conditions (9), map D 


onto the domain A. Then for the projections Q(21, £1), wx(21, £a) of B7(21, £2), 
yO Sa, S TP, k— 1,2, the inequality 


a (a1, £2) + 00? (T1, 22) + 02201? (£1, T2) + A122” 
w ff er \ 


< (Mm) V (0) + 28m (9) 
holds. V(-  -)=volume of :--:. 


Proof. By (2.8) and (2.9) 


G el Tiges] + ay +ß (v1, Ve) 











EN (Y1, Y2) (41, Y2) 8 ô (Ys, Y2). Y2) d(Yı, Ye) 
80) Z | alw, wa) |? O (ux, Vx) 
= | O( 41; Yo) ier | O( 42542) | 





Multiplying (37) by dyıdy., integrating over D*(2,,2,) and using (37), 
(84), (35), we obtain 


SS EST won S SERAT ana 


ST anaes fS] t 


"(a3 ,a2) 


8(w1, We) |? FF 
<= 2 + (max) 
J 1 Low (Yz Yz i se ý O°. 2) E 
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Applying the Schwarz inequality to the left hand side of (88) and using the 
notation introduced in (28), we have 


(39) {APP + AP 2?) + AP IT + APR}? 
ALO*(a1, 2) ] 


ws, 2) iti f 
dy, dy +- 28") dyd 
s SS ligiss 8 (Ys) Yo) Y2) 9,09 f A 


Ooue) 
Multiplying (39) by da, da, integrating over [RP S Tr S 2, k=1,2], 
using (2.6) and the lemma, p. 414, we obtain (36). 
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NORMAL CONGRUENCE SUBGROUPS OF THE 
MODULAR GROUP.** 


By Morris NEWMAN. 


1. Introduction. Let T be the 2 x 2 modular group; that is, the group 
of 22 rational integral matrices of determinant 1 in which a matrix is 
identified with its negative. If n is a positive integer, T(n) denotes the 
principal congruence subgroup of T of level n, consisting of all elements of T 
congruent modulo n to a scalar matrix. The subgroup of T(n) consisting of 
all elements of T congruent modulo n to the identity matrix J is denoted by 
T,(n). Then T(n), T,(n) are normal subgroups of T. A subgroup @ of T 
containing a group T(n) is termed a congruence subgroup, and is said to be 
of level n if n is the least such integer. Notice that T,(n) is not in general 
a congruence subgroup, according to the definition above. The groups I; (n) 
are fully discussed in Gunning’s book [2] and it should be noted that these 
are customarily referred to as principal congruence subgroups. 

The principal result of this paper is that a normal congruence subgroup 
of level n, where (n,6) —1 is necessarily the principal congruence subgroup 
T(n). The proof will be arranged for an induction and will in fact yield some- 
what more. At the end of the paper some open questions are discussed. 


2. Preliminary material. If m and n are positive integers, then (m,n) 
will stand for their greatest common divisor and [m,n] for their least common 


multiple. We set 
1 1 0 —1 
s-(} i ae a o) 
Then, as is well-known, 8 and T generate T and 


. T? = (ST)? =—I 
are defining relations for T. 
We require the following lemma : 


Lemma 1. The principal congruence subgroups satisfy 


(1) T(m)T(rn)=T((m,n)), 
(2) T(m) OT (n) =T([m,n]). 
* Received —______; revised July 9, 1963. 


1 The preparation of this paper was supported by the Office of Naval Research. 
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Hence by one of the isomorphism theorems 


(3) T((m,n))/T(m) =T(n)/T(Im,R]). 
Stated otherwise, (3) becomes 
(4) T(d)/T (da) =T(db)/T (dab), 


where d is arbitrary and (a,b) =1. A proof of Lemma 1 for the groups 
T, (n) is given in [4]. The modifications required for the groups T(n) are 
slight, and we forego the proof. 

The index (T: T(n)) is readily computed: It is just 


(T: Tı(n))/(T(r): Tı(n)) 


where 

(5) . (T: ra(n)) =m (1—1/p*), 

(6) (T(n) :Ti(n)) = 2MF(n). 

Here w(n) is the number of distinct primes dividing n, and 

1 n odd 
3 ein 

(1) fm) st gin 
2 8|n 


We note that if p is an odd prime dividing n, then these imply 
(8) (T(n): D(np)) = p”. 


When n is itself a power of an odd prime, T(n) consists just of those 


matrices MET satisfying M = + I (modn). We now prove the following 
lemmas: 


Lemma 2. Let p be an odd prime, n > 1a power of p. Then T(n)/T(np) 
is an abelian group of order p? and of type (p, p,p). The generators may be 
chosen modulo T (np) as 


In _f1 0 lpn —n 
0) 1=(, ni B-(, a) om ( n — 
Lemma 3. Let p bean odd prime, p|n. Then T(n)/T(np) is an abelian 


group of order p° and of type (p, p,p). 


Proof of Lemmas 2 and 3. We first prove that Lemma 3 is a direct 
consequence of Lemma 2. We can write n = pin,, where tZ 1 and (n, p) =1. 
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Then 
T(n)/T (np) =T (nıpf) /T (nip) 
=T (p*)/T (p), 


by (4). By Lemma 2 the latter is abelian of order pë and of type (p, p, p) 
and Lemma 3 follows. 

We turn now to the proof of Lemma 2. Suppose that U,VET(n). 
Then V=u/ (modn), V =v] (modn), where u,v == + 1. Thus 


(U —ul) (V —vI) =0 (mod n?) 
and it follows that 


UV =0U + uV —uvl = VU (modn?). 
Since p | n the congruence also holds modulo np which implies that T(n)/T(np) 


is abelian. Now let 
i i+an pn 
u==( m i Yin) 
be any element of T(n). Then «+ 8=0 (modn), and it is easily verified 
that 
M = + APBY*C® (mod n*). 


Hence the matrices (9) are certainly generators modulo I'(np), and each is 
of period p modulo T (np). That they are independent modulo T (np) is seen 
from the congruence 
~{ 14% a) à 

ABC = ch (mod n?) 
which implies that A*B¥C*==+I1(modnp) if and only if c=y=z=0 
(modp). The proof of the lemma is complete. We remark that when 
n= p=? the matrices A,B,C are not independent, since then ABC =— I 
(mod 4). 


3. The principal lemmas. In this section we develop the lemmas 
directly required in the proof of the main theorem. It will be necessary to 
give special proofs for a prime or the square of a prime to make the induction 
go through generally, and the lemmas that follow are devoted to this object. 
Throughout this section m, n denote positive integers and p a prime. 

Lemma 4. Let p be a prime >3. Let G be a normal subgroup of T 
such that 


TDIGDT(p). 
Then G=T or T(p). 
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Proof. This lemma is proved by Dickson in his book [1] on the linear 
groups, in another form. Dickson shows that LF(2,p) =T/T(p) is a simple 
group, if p is a prime > 3. . 


We introduce the notation (to be used in the lemma that follows) 
(10) A*BuC? — (2, y, 2) 
where A, B, C are given by (9). 


Luma 5. Let p bea prime >2, p|n. Let G be a normal subgroup 
of T such that . 
T(n) D G@DT (np). 
Then G=T(n) or (np). 


Proof. Assume first that n is a power of p. We remark that G/T (np) 
is abelian since it is a subgroup of the abelian group T(n)/T(np) (Lemma 2). 
Suppose that G&T (np). Then there is an element M == (z,y,z) € G where 
at least one of z, y,z is prime to p. Since G is normal, 


S(M)=SMS*, T(M)—TMT* 
belong to G. It is an easy computation that | 
(11) S(A)=4, S{B)—C, S(C) =A?*B*C? (modn?) 
and that | 
(12) T(A)=B", T(B)=47, T(C)=4"B®?0" (modn?). 
We find from (11) therefore that 


M = (2, 4,2) € G, 
M, = (z — 22, — 2, y + 2z) € G, 
M, = (z — 2y — 62, — y — 2z, 2y +32) € G. 


Thus MM,-?M, == (— 2y— 2z,0,0) € @ which implies that (y-+2,0,0) E€ G 
since p> 2. There are now two possibilities: If (y+ z, p) —1 then (1,0,0) 
—A€G. The equations (11), (12) now imply that (0,1,0)—=B and 
(0,1,1) =C also belong to G which in turn implies that G=T{n). If 
however y + z==0 (mod p) then from M+M, we deduce that (2y,0,0) € G 
which implies that (y,0,0) € @ since p>2. If p|y then 
(z, p) =~ 1, (x, 0,0) € G which implies that (1,0,0)€ G As 
@=T(n). If (p,y)=1 then also (1,0,0)€ @ again imply” 
Thus in all cases we have proved that G=TI'(n) or T(np),& 
the lemma is concluded, if n is a power of p. 
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Now suppose that n= pin, where $21 and (m,p)==1. Then the 
inclusions of the lemma become 


(18) T(p'n) D@DT(p*n.). 
Intersecting and producting in (18) with T(p'"), we find that 


pm) D EAT (p*)D T(p"m), 
Tip) D GE (p*) D Tep*). 
Hence GNI (pt) =T(p'"n,), and (by the first part of the lemma) 
GU (p'*) =T(pt) or Tip). IE GU(p*)=T(p*) then GCT(p*). 
Thus 
G C T(P) NT(pm) =T (pn) 
T(p*) D GT(p™) D T(p™. 


which implies that @ == T(ptn,). Thus we can assume that GT(p") =T (pf). 
Then (3) gives f 
T(p')/T (pi) = G/T (pm). 
But also by (8) 
T (pt) /T (p) = T (p'n)/T (pin). 


Hence 
T (p'm)/T (pn) = G/T (pn) 
and since FC T(p'n), it follows that G=T(p'n,). This completes the 
proof cf Lemma 5. 
We also require 
Lemma 6. Let p be a prime >3. Let G be a normal subgroup of T 


such that 
(14) TD GD T(p?). 


Then Q =T, Tip) or T(p°). 
Proof. Intersecting and producting in (14) with T(p), we find that 
Tip) > @NT(p) DT), 
rD 0r(p) Dip). 


Lemma 5 implies that @NT(p) =T(p) or T(p?), and Lemma 4 implies that 
GT (p) =T or T(p). If ENT(p) =T(p) then TIGDT(p), =T or 
T(p). IE Gr(p)=T(p) then T(p)D GDT(#), @—T(p) or T(p°). 
Assume then that GN F(p) =T (p°), GT(p) =T. Then 0/G =T(p)/T (p°). 
By Lemma 2 T (p)/T (p°) is abelian and so therefore is T/G. This implies that 


7 
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G D T, the commutator subgroup of T. But (T: IY) =6 (see [3]) and so 
(T: @)|6. However 

(T: G) = (T (p): T(P)) =p, 
and so p*|6. This is impossible however. We have proved therefore that 


always, G =T, T(p) or T(p?) and the proof of the lemma is completed. 
We also prove 


_ Lemma 7. Let p be a prime > 2, p In. Let G be a normal subgroup of 
T such that 
(15) T(n) D GD V(np?). 


Then G=T(r), T(np) or T(np?). 
Proof. Intersecting and producting in (15) with T(np), we find that 


T(np) D ENT (np) DT(np®), 
T(n) D GL (np) DT(np). 


Then Lemma 5 implies that ENT(np) =T(np) or T'(np*), and that 
GT (np) =T(n) or T(np). If ENT (np) =F (np) then T(n) D GD (np) 
and Ge=T(n) or T(np). I£ GT(np) —T({np) then T(np) D GD TP (np?) 
and G=T(np) or T(np*). Assume then that ENT (np) =T(np?), GT (np) 
==T(n). Then 

G/T (np?) =T(n)/T (np). 


Since p|n T(n)/T(np) is abelian of type (p, p,p) (Lemma 3) and so 
therefore is G/T (np°). Suppose that P, Q, E are elements of G (and hence 
o£T(n)) such that G@/T (np?) is generated by P, Q, R modulo T(np*). Then 
we have P=u/I+nE, E an a matrix. However, we know that 
PreT(np?) and 


= („I + nE) = pPl + uP'npE (mod np*), 


since p| n. This implies that PET(np). Similarly Q and R belong to T (np) 
and so G@CI(np). Hence @=T(np), and the lemma follows. 


Lemma 8. Suppose m has the property that for any normal subgroup 
G of © 
TD@DT(m) implies G=T(d),d|m. 
Then m also has the property that for any normal subgroup G of T and any 
n with (m,n) =1 


T(n) D@DT(mn) implies G—=T(dn),d| m. 
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Proof. Let @ be a normal subgroup of T such that 
T(n) D @DT(mn). 
Producting by T(m) we obtain 
TD G0(m) DT(m). 
By the hypotheses of the lemma it follows that 
GT (m) =T({d),d|m. 
Now intersecting by T(m) we obtain 


T(mn) D GNT(m) DT (mn), 
ENT(m) =T (mn). 


Hence 
T(d)/T(m) = G/T (mn). 
But also by (4) 
T(d)/T(m) =T(dn)/T (mn), 
since (m,n) —=1 and d|m. It follows that 
(16) G/T (mn) =T (dn) /T (mn). 


But T(d)D@ (since T(d)—=GT(m)) and T(n)DG. It follows that 
T(dn) D G (since (m,n) =1 and d|m) and this together with (16) implies 
that T (dn) = G, completing the proof of the lemma. 


4. The- principal theorem. We combine Lemmas 4, 5, 6, 7, 8 in our 
first theorem: 


THEOREM 1. Let p be a prime >3, n a positive integer. If G is a 
normal subgroup of T such that 


T(n) DGDT(np) 
then G=T(n) or T(np) ; and if G is a normal subgroup of T such that 
T(n) D@DT(np%) 
then G=T(n), T(np) or T’(np®). 
We are now in a position to prove 


THEOREM 2 (the principal theorem). Let m, n be positive integers, 
(m,6)—1. Let G be a normal subgroup of T such that 


(17) T(n) D@DT(mn). 
Then G=T(nd),d|m 
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Proof. The proof will be by induction on n and on Q(m), the total 
number of primes dividing m. 

The theorem is certainly true for all n and for m=1, p or p°? where p 
is a prime > 8, this being the content of Theorem 1. Suppose the theorem 
true for all n and for all m such that (m,6) =1, Q(m) <k. Let m be such 
that (m,6) =1, O(m) =k. We can assume that m is neither a prime nor 
the square of a prime since the theorem has already been proved in these cases. 
Let d be any divisor of m, d>1. Intersecting by T(nd) in (17) we obtain 

T(nd) D GNT(nd) DT (mn). 
By the induction hypothesis (with nd replacing n) 
GOT (nd) =T (ndå), d| m/d. 


There are two possibilities. If dd< m for some d, then Q(dd) <Q(m), 
T(n) DG@DT(ndd) and the proof is completed by induction. Otherwise we 
have that 


(18) GOT (nd) =T(mn),d|m,d>1. 


We now apply the same process with products. Producting by T(nd) 
in (17) we obtain 
T(n) D @T(nd) D T(nd). 
Then if d < m, the induction hypothesis implies that 
GT (nd) =T (n8), 8| d. 
Thus 
T(n) D@DT(mn). 
Again there are two possibilities. If &>1 for some d, then the proof is 
completed by induction. Otherwise we have that 
(19) GT (nd) =T (n), d| m, d < m. 
Combining (18) and (19) we conclude that for every divisor d of m, 
1<d<m we have 
G/T (mn) =T(n)/T (nd). 
Hence (T(n): T(nd)) is independent of the choice of dd 1<d<m. But 
m is larger than 1 and is neither a prime nor the square of a prime. This 


implies that primes p, q (not necessarily distinct) exist such that pq |m, 
pq<m. Then choosing d= p, d= pq we find that 


(T(n): T(np)) = (T(n): T(npg)) 
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so that 
(E (np) : TP (npg)) =1. 


This is not possible however (since T(np) s4I'(npq)) and so the proof of 
the theorem is concluded. 


5. Some open questions. The restriction (m,6) <1 cannot in general 
be removed. For example if r” is the fully invariant subgroup of T generated 
by the n-th powers of the elements of T then 


TIMTDTß), 
Por > Pie); 
POP OT). 


Here T?, T? and I” (the commutator subgroup of T and just T?NT®) are 
normal congruence subgroups of levels 2, 3, 6 respectively but are not principal 
congruence subgroups. Similarly the intersections T? N r(n), T’NT(n), 
I’NT(n) are normal congruence subgroups but not principal congruence 
subgroups. The problem of classifying all normal congruence subgroups of 
level n where (n,6) >1 remains open. The theorem can be extended to 
the higher dimensional modular groups, but the extension to the symplectic 
modular group is (presumably) more difficult and is also an open question. 
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ON AFFINE TRANSFORMATIONS OF COMPACT ABELIAN 
GROUPS.* 


By F. J. Hanw.t 


Introduction. By an affine transformation of a group we mean a 
homeomorphism of the group onto itself which is the composition of an 
automorphism followed by a translation. The purpose of this paper is to 
study the ergodic theory of affine transformations of compact abelian groups. 
In Section 1 such transformations are completely classified according to 
whether they are ergodic, weakly mixing or strongly mixing. In Section 2, 
we concentrate on the affine transformations of the torus and classify these 
according to the eigenvalues of the automorphism part of the affine trans- 
formation.” Section 3 makes a closer examination of the spectrum of an affine 
transformation. The L, space of the group is decomposed into two stable 
orthogonal subspaces on one of which the affine transformation has discrete 
spectrum and on the other of which the affine transformation has continuous 
spectrum. In Section 4 the question of strict ergodicity is discussed and 
standard forms are derived for transformation of the torus. It is shown that 
a certain class of ergodic affine transformations of the torus are always strictly 
ergodic. In Section 5 we apply some of the previous results (Section 2 and 4) 
to prove the following theorem of Hermann Weyl [8]: Let 


D(2) = ama” + ama +- tat 


be a polynomial with real coefficients and a,540, m>0. If there is an 4, 
m Zi >Q, for which a is irrational then the numbers p(n), n—0,1,2,3- - - 
are uniformly distributed mod 1. 


1. Affine transformations of compact Abelian groups. If X is a 
compact abelian group we let X be its character group. The elements of X 
shall be designated by lower case Roman letters z,y,2° - - and the elements 
of X shall be designated by lower case Greek letters &,¢,---. We use the 
additive notation for X and indicate the value of the character é at x by £(z). 
By Aut(X) we mean the automorphism group of X. The group Aff(X) 
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3 The results of this section have been announced in L. Auslander and F. Hahn, 
“ Discrete transformations on tori and flows on Solvmanifolds,” Bulletin of the American 
Alathematical Society, vol. 68 (1962), pp. 614-615. 
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==X-Aut(X) will be called the group of affine transformations of X. Here 

the dot indicates semi direct product. An element (zo, 4) in Aff(X) acts on 

X as follows (xo, A)2—= 2 + A(z). Since Aut(X) preserves Haar measure 

we see that each element 8€ Aff(X) is measure preserving. Each such 8 

induces a unitary operator Vg on L,(X) as follows (Vsf) (x) —f(S(z)). 

We recall that the character group X forms an ortho-normal basis for L,(X). 
We list the following definitions and results from ergodie theory: 


1. The transformation S is said to be ergodic if the only eigenfunctions 
with eigenvalue one of Vg are the constant functions. 


2. The transformation S is said to be weakly mixing if the only eigen- 
functions of Vg are the constant functions. 


3. The transformation $ is said to be strongly mixing if for each 
f, g € La(X) we have lim (Vs"7, 9) = (f 1) (1.9). 


We recall that in general strongly mixing implies weakly mixing implies 
ergodic. (For instance see [6] or [7]) If S=(%,A) and z, —0 then 
Halmos [5] has shown that ergodic, weakly mixing, and strongly mixing are 
equivalent. He has shown that A is ergodic precisely when the transformation 
Va which it induces on X has no periodic orbits aside from the trivial one. 
On the opposite hand when A is the identity and z€ X we know that 9 is 
never weakly mixing. We also know that S is ergodic if and only if a 
generates a dense subgroup of X. In this section we shall show that for 
SE Aff(X) ergodic is not equivalent to weakly mixing but that weakly 
mixing and strongly mixing are equivalent. We shall also characterize’ these 
cases completely. l 


THEOREM 1. If 8 = (a,A) € Aff(X) and if each character E541 has 
an infinite orbit under Va then S is strongly mizing. 


i Proof. If é= 1 then 
1= (é 1) (1,6) = (é, €) = lim (V "£, é). 
If 1 then we observe that Vs(é) —&(z,) Vaé -and in general Va" (£) 
=n (Zo) V aé where | An(%o)|—= 1. Since V4*é is again a character it follows 


from the hypothesis that it can never be a particular, character for more than 
one value of n. We have 


61) (Ln) = 0 — lim An (6) (Vad, 7) = lim (Var, 9). 
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We have shown that if H, is the subspace of L,(X) consisting of constant 
functions then V* converges weakly to the identity on Ho. On the other hand 
(Vg"é,n) converges to zero if é=41 and &,n€ X. Using the fact that any 
elements f, g in L,(X) have Fourier series expansions in terms of the charac- 
ters and standard continuity and linearity arguments we obtain (f,1) (1,9) 
= lim(Vg"f,g) showing that 8 is strongly mixing. 


THEOREM 2. If S == (2,A)E Af(X) and if there is a EER, EA1 
and a positive integer n for which Va" =é then 8 is not weakly miwing. 
(Consequently S is not strongly mixing.) 


Proof. Choose EC X, 541 and n satisfying the above hypotheses. We 
seo that Vg"—=A(é)é where |A(é)|—=-1. Let M be the space spanned by 
& Vsé,* © +, Vg" é. We see that M is orthogonal to the constant functions 
and Vg(M) CM. Since M is finite dimensional it follows that there is an 
eigenfunction ge M for Vg. Since g is not constant we see that 9 is not 
weakly mixing. 

COROLLARY 3. If S=—(a#,A)€ Aff(X) then the following statements 


are equivalent. 


1. The unitary operator V4 restricted to X has no periodic points except 
the trivial one. 

2. A is ergodic. 

8. 8 is strongly mixing. 

4. § is weakly mixing. 

The equivalence of 1, 8, 4 is the content of the preceding theorems. The 


equivalence of 1 and 2 is proved in [5] by Halmos. 


We now wish to exarnine the case in which A is not ergodic. If A is 
not ergodic then then set F of characters é, §=41, which are periodic under 
Va is not empty. For any non-negative integer n we see Vg" = Ap (£) Varé 
where Aq (E) = E (£o + At + Anm +: + Anteo). 


Lemma 4. If S= (%,A) € AH(X) and if there is a character £ €541 
and a positive integer n such that Va"é == é then S is not ergodic. 


Proof. Let g=E+VsE+ Vs? +: + Vai Since (g,1) —=0 we 
see that g is not constant. Since Vsg = g we see that S is not ergodic. 


THEOREM 4. Suppose S = (x, A) € Aff(X) and S is not strongly mixing. 
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Under these conditions 8 is ergodic if and only if for each € F and for each 
positive integer n for which V aré = é we have rAq(€é) 1. 


Proof. If £c F and if V4"é = é and ànlé) == 1 we have Vg"é = Alé) V arle) 
== £ and it follows from Lemma 4 that S is not ergodic. 


Suppose now that for each £EE F and for each n for which Vu"é==€ we 
have A, (é) 541. Under these conditions we wish to show that if g € L,(X) 
and Fsg =g then g is a constant. Since the elements of X form an ortho- 
normal basis for L,(X) we expand g in a Fourier series relative to this basis 
and we obtain 

g= > (9, é) & 
Also 
Fag = z (9, &) V sé = 2 (9, 6) Ax (é) Fafi 


For each &€ X we have Vaf;€ X. Comparing coefficients of like terms in 
g and Vg we obtain 
(9 Vuk) = À (&) (9; &) 


and consequently 


| (9, Vuk) | Zus | (9, &) |. 


We wish to show that this implies (9,&) =0 if &5¢1. We distinguish 
two cases &¢ F, & 41; and &€ F. In the first case if (g, é) 40 we would 
obtain 054|(g,4&)|—=|(g, Yar&)| for each n. This is impossible since 
2 | (9, &)|? < +o. 

Suppose now „€ F. There is an n for which V4" =y. We also have 
g= Vtg ZEV 2 (g 6) An (6) Vane. The character 7 appears 
somewhere in this sum and F4” =q. Comparing coefficients of g and Vg"g 
we obtain 

(9,1) =An(m) (Hm): 
Since às(n) 541 we must have (9,7) =0. 

Since all other coefficients vanish we have g=(g,1) and thus 8 is 
ergodic. 

We remark that in the special case where A is the identity the above 


theorem yields the classical result which states that S is ergodic if and only 
if &(z,) =1 implies ==1 for each €€ X. 


2. Affine transformations of the torus. We wish to apply the pre- 
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vious results to classify affine transformations of the torus. We let X be the 
m dimensional torus. Then X = R™/D. where R™ is the additive group of 
the real Euclidean m dimensional vector space and D is the subgroup of points 
n= (n,,‘  ,n) where n; are integers. Any automorphism A of X may be 
lifted in a unique fashion to a linear transformation of R» which preserves D. 
Conversely any non-singular linear transformation A of R™ which preserves D 
induces a unique automorphism of X. If we let e= (0,- - -,0,1,0,-- -,0) 
(1 in the i-th place) t—1,2,- - -,m, be a basis for R” then any non-singular 
linear transformation A of BR” which preserves D has a matrix representation 
(ay), with respect to the e, in which ay are integers and determinant (ay) 
— +1. We shall denote the adjoint of A by A*. 

The character group X is isomorphic to D and this isomorphism is given 


i m 
by (nner ` `, nm) =n — exp(z,n) where exp = e18 and (m,n) = X ne 
41 


where T= (2,25,° * ',2m). We note that if A € Aut(X) then Yıexp(z,n) 
= exp (Ar, n) —=exp(z,A*n). Here A is looked upon as a linear trans- 
formation of R* which preserves D. 

For each positive integer p we define 


K,(A) = Kernel[A*?—I] ND. 


Since A*—I is a factor of A*?—I we see that K,(A) C K,(A) for p>1. 
We now interpret the theorems of the previous section in terms of the a 
values of A or what is the same in terms of K,(A). 


THEOREM 5. If 8 = (17,4) is an afine anifarnaton of the m dimen- 
sional torus X and tf K (A) = {0} for all p=1 then 8 is strongly mizing. 


Proof. Because of Theorem 1 we need only show that each non-trivial 
character has an infinite orbit under V4. If this were not so there would 
exist an n E€ D, n>40, and an integer p such that exp (z, n) — V4? (exp (z, n)) 
= exp (z, A*?n). We conclude A*Pn = n and thus K,(A) +4 {0} which con: 
tradicts the hypothesis. 

We observe that this is the case whenever A does not have eigenvalues 
which are roots of unity.. 


THEOREM 6. If S= (zo 4A) is an affine transformation of the m 
dimensional torus X and if there is an integer p > 1 such that K,(A) 4 K,(A) 
then S is not ergodic: - 
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Proof. -Because of Lemma 4 we need en con tinel a character which i is 
periodic under Vg. We let : ; : 


B, = APit Ara. ENEE 
According to the hypothesis there is an n€ D, n40 for which A*?n =n but 


A*nsn. If w= (A*—I)n then n’340. Since Am — I= Bo* (A*— I) 
and (A*?—I)n=0 we see that Bp*n == 0. We observe 


At = AA — Dn = (AP =D) A*m = (dran. 
We conclude the theorem in the folowing manner” u 


Vg? exp (a, n) = exp (B,r,, n’) exp (Ag, n) 
— exp (Zo, By*n’ exp (z, A*?n’) 
==exp(z,n’). 

In order to make the next theorem more concise we make the following 
definition which is a generalization of rational independence. 

Definition 7. If cm (Tu 2%2,° °° +, 2m) € R” and if D,CD is a sub- 
module we say that the numbers 2,,- - -, 2% are rationally independent over 
D, if whenever n€ D, and (z,n) is rational- then n—0. When there is no 
possibility of confusion we will say is rationally independent over Dy. 

If Dy == D we observe that the previous definition reduces to the classical 
definition of rational independence. It is easy to see that x is independent 
over D, if and only if whenever (2,n) ==0mod1 and n€ D, then n—0. 


THEOREM 8. Let S==(%,A) be an affine transformation of the m 
dimensional torus X. Suppose that {0} 4 Ki(A)—=K,(A) for all p=1.. 
Under these conditions the following two statements are true: 

a) § is ergodic if and only if z, is rationally independent over K,(A). 

b) Ss not weakly mizing. 

Proof of a). Suppose z, is rationally dependent over K,(A) ==K,(A). 
Then there is an ne K,(A), n0, or which (zon) ==g/p. We observe 

Ve exp (2, n) == EXD (Bots, n)exp (Apz, n) y 
= exp (2, (4°71: < -+ A* -+ I)n)exp(z, A*m) 
= exp (To, pn)exp(z,n) =exp p (To, n)exp (z, n) 
EDEN == ap 
It follows from Lemma 4 that’ 3 is not ergodic. 
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Suppose now that 9 is not ergodic. We wish to construct an ne K,(A), 
n40, for which (z,n) is rational. Since J is not ergodic it follows from 
Theorem 4 that there is an n€ L, n340, and an integer p such that 


Va? exp (x, n) = Ap (exp (z, n) ) Va? exp(z, n) 
= Vp? exp (z, n) =exp(z,n). 
From this we get two pieces of information. First of all 
exp (z, n) = Va? exp (z, n) — exp (z, A*Pn) 
from which we conclude n— A*Pn or that n€ Kp (4) = K,(A). 
Secondly we see 
1 — Ap (exp (0, 0) ) — exp (To, (Art + AP +A®H+D)n) 
= exp (Zo, pn). 
From this we conclude that 
(To pn) = p(X) =0 modi 
or that (zo n) is rational. 


Proof of b). Since K, (4) >£ {0} there is an n 0 for which Vy exp(z, n) 
—exp(z,A*n) —exp(z,n). It follows from Theorem 2 that S is not weakly 
mixing. 

When A is the identity Theorem 8 becomes the measure theoretic version 
of Kronecker’s little theorem. 


8. Spectrum of affine transformations of compact Abelian groups. 
In this section we wish to examine in more detail the spectrum of the operator 
Vg (S= (2,4) E€ Aff(X)) acting on the Hilbert space L,(X). Our first 
theorem is a careful statement of the results implicit in the preceding two 
sections. 


THEOREM 9. The space L,(X) ts the direct sum of two orthogonal sub- 
spaces 9, and Ga with the following properties: 


&) Va: Hi> Di 41,2. 


b) Let Vim Vs | K, t= 1,2. The unitary operator V, has pure point 
spectrum. 


c) S2—D Ha where each Ha is separable and has an orthonormal basis 


{fiat t—=0,+1,+2,43,---}. Moreover Vofta=fusa and thus 
V: has pure continuous spectrum. 
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Proof. We let $: be the subspace spanned by the set of all characters 
éc X which have a finite orbit under Vu, that is there is an integer n for 
which Vy"f—==é We let Qa be the subspace spanned by the set of all charac- 
ters which have infinite orbits under V4. We verify easily that a) holds 
because Vgf =A; (é) Vaé where | Ai(a)| =1. 


The space $, decomposes into the direct sum of finite dimensional sub- 
spaces which are stable under Vg. These subspaces are formed by choosing 
any character é for which there is an integer n such that V 4”é = ¢ and taking 
the space spanned by & Vu?é---,Va"é On any such subspaces V, is a 
finite dimensional unitary operator and thus has pure spectrum. This remark 
concludes the proof of b). 

The proof of c) is clear when we observe that the subspaces Qa are 
merely the spaces generated by the orbits of the characters generating $2 
(see [6], p. 53). 

A slight further examination of §, is of interest. Let é€ X and €€ §,. 
Also let $ı(£) be the space spanned by & Vué, Vu2é,- - -, Vart where n is 
the period of é under V4. We observe Vg (Vai (€)) —ajVai"4(é) for j= 0,1, 
2,: ,n—1. If we let D(£) be the determinant of V, restricted to & (£) 
we see that D (£E) = (—1)"% a, * Q, * a *'* * "An-ı. Moreover the characteristic 
polynomial for V, restricted to Hı(£) is given by (—1)*(A"—D(€é)). Then 
the eigenvalues are n-th roots of D(é). Combining this with Theorem 8 we 
obtain 


COROLLARY 10. S is ergodic tf and only if for each EE ÈN G1, ESEL 
we have D(£) 1. 


. We examine still further the subspace $, and the operator V,. Let 
Ë =N È and let H*—={2: (x) —=1 if ¿€ H}. It is not difficult to 
verify that H is a subgroup of the discrete group X. We let H—X/H*. 
It is known then that A is the character group of H. The set Ê is stable 
under F4 so it follows that H* is mapped onto itself under A. Thus we make 
S = (To, A) act on H in the following manner S(z+ H*) = T, + Ar + H*. 


THEoREM 11. The space Q, =— L,(H) and the action induced by S on 
L;(H) is the same as the action of V; on $ı. The action of S on X is ergodic 
tf and only if the action of S on H is ergodic. If S is ergodic on X then 
there ts an element ho€ H such that 8(h) =—=h + ho for all he H and the 
subgroup generated by h, is dense in H. 


Proof. The first sentence of the theorem merely sums up the paragraph 
immediately before the theorem. If we look at the action of Vg on L,(X) 
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we see that the eigenfunctions must all lie in §;. Thus § is ergodic on X 
if and only if the dimension of the eigenvalue one space of V, acting on $ı 
is one. Since the action induced by Son Z,(H) is the same as the action 
induced by V, on $ı the second sentence holds. 


If S is ergodic on X then S acting on H is also ergodic. This action 
on H induces the same unitary action as V, on $.. Since V, acting on §, 
has pure point spectrum the results of the last sentence of the theorem follow 
from standard theorems in ergodic theory. (See [6], p. 46 et. seq.) 


4, Strict ergodicity and standard forms of affine transformations on 
the torus. If Q is a compact metric space and T a homeomorphism of Q we 
recall the following definition. 


Definition 12. The homeomorphism T of the compact metric space Q is 
said to be strictly ergodic if there is a unique T invariant Borel measure p 
min p(Q) =|. 


We point out that this is commonly called “uniquely ergodic” but we 
follow the usage of Furstenberg[4], p. 574, since many of the references are 
to this paper. 

Let » be any T invariant measure on Q and let O (Q) be the set of all 
continuous complex valued functions on Q. 


Definition 13. A point w€Q is a to be generic for (Q, T, p) if for 
each f in C(Q) we have 
© N- - 
lim 1/N Z f(T") = f” fde 
If T is ergodic then it is direct consequence of the ergodic theorem that almost 
all » (with respect to a) are generic points for (Q, T, p). 


We state the following known theorem for later ana For . its 
proof see for instance [4], p. 575. 


. ; THEOREM. 14, If p îs a T invariant Borel measure on the compact metric 
space then the following statements are equtvalent: 


1. Tis strictly ergodic on Q with invariant measure p 
` 2. Every point of Q is generic for (Q, T, u). 


N-1 
3. 1/N I f(T) converges uniformly in w to Í, f dy for each f€ O(a). 
n=0 


We consider two compact metric abelian groups X, and X,. Let 
A€ Aut(X,) and let B: X,—>X, be a homomorphism. 
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Let y= (yy y2) €X1X Xo. Let X =X, X X, and let A€ Aut(X) be 
given by A(x) =A (ay, 22) = (A: (21); 22+ B(2:)). If m are normalized 
Haar measure on X, we know that u, is A, invariant and we observe that if 
pom py X pe then p is A invariant. -To see this we need merely examine the 
integral of functions in C(X) of the form f(r) — fı(z)fx(z) where € C(X,). 


SALE) due) = f ffi(Ar (ar) ) fe (22+ B (21) ) dp (21) das (22) 
— ffA (2) ) [Sf fa(ae + B(@1)) dua (2) Jå (22) 
= ffi(Ar(t)) Lf fe (te) dpa (ta) ]dp (21) 
= Sfi(t1) dps (21) + f fe (ee) dps (Ta) 
— ff(z)dp(z). 


The idea of the following theorem is essentially contained in [4], p. 578, 
but for completeness we include its proof here. 


THEOoREM 15. In terms of the preceding notation let S—(y, A) € Aff(X). 
The product measure p is invariant under 8. If Bı = (y:,41) € AR (X) is 
strictly ergodic and tf S is ergodic for p on X then 8 is strictly ergodic on X. 


Proof. Since translation preserves the product measure a it is clear 
from the previous discussion that » is S invariant. 

We first observe that if z= (z,,2,) is generic for the product measure p 
then for any y € Xa, (T1, %2 +y) is generic for u. To see this fix y € X, and 
let T (t1, ta) = (2,224 9) 


N-1 . -1 
Lim 1/N E f(8* (2o 2+ y)) = lim 1/N E f-T (8*(a 2) 


— fFOT (t, 22) du = S fF (1, 02+) dps (21) dpa (23) 
= ff (2u 22) dy = ff dp. 


Thus if we let r: X, X X¥,— X, be the projection onto X, and if E (a) 
is the set of generic points for (X, 8, p) then we see that E (p) = x(E (p)) X Xa. 

Suppose v is an ergodic S invariant measure on X. We wish to show 
a==r. To do this we need only show that there is a point se X which is 
generic for both (X, 9,4) and (X,8,v) since this implies (fdu— ff dv for 
all fe C(X).: On the Borel subsets of X, define the measure v, as follows 
vı(Eı) ev(E, X X,). The measure v, is S, invariant and from the strict 
ergodicity of 8, it follows that vı == p. Let E(v) be the set of generic points 
. of (X,8,v). From the fact that S is ergodic and from the ergodic theorem 
we obtain u(E(p))=v(E(v))=1. Since E(v) Cr(E(v))X X, we also 
see that 1 =v, (r (E (r)) = v(4(B(v)) xX Xe) Bv(E(v)) =1. And similarly 
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p(r(E(p)))=1. Since =» we have (E (g)) N r(E(v)) Ø. - The 
fact that F(p) —-r(E(«))X X, implies E(u) ON H(v) A@ which concludes 
the proof. 

For the remainder of this section we shall only consider affine trans 
formations on an m dimensional torus. As was pointed out earlier the auto- 
morphisms of the m dimensional torus are in one to one correspondence with 
the automorphisms of the free abelian group on m generators. With this in 
mind we will be able to make use of the following theorem. (At this point 
I would like to acknowledge some helpful suggestions by G. Seligman.) 


Taxorem 16. Let G be a finitely generated free abelian group and let 
a be an endomorphism of G. Under these conditions there exists a sequence 
of subgroups G= G D QD Gr + -D Gy, kZ0, such that the inclusions 
are proper; o: Gi—> Gu, for +—=0,1,- > -,4—1; 0 (Gy) C Gy and Gy/o( Gy) 
is either trivial or is a torsion group. Moreover there exist subsets By C Gi 
with By > B,D: - -D By such that each B, ts a finite set of independent 
generators of Gy. 


Proof. Let L= Q ®, @ where Q is the additive group of rational numbers 
and Z the integers. L is a vector space over Q and o becomes a linear trans- 
formation.on L if it is defined on decomposable tensors as follows o(r®q) 
=r@e(g). Let L=? (L) fort—0,1,2,---. There is a first k for which 
Ly Ly. We then obtain the properly descending chain of vector spaces 


L=LDLDLD:-D Lp 
If we let G= 2,9 G then we have the properly descending chain 
G=—@2G20G,0°:-:DG,. 


We see that ofG,) =o(L,NG) C o(L4) No(G) Clan Gm Qui for 
4—0,1,2,--+,4—1. We wish to show that G;/o(G,) is a torsion group 
if it is not trivial. If it were not then there would be an element ve G, for 
which nv ¢ o (Gx) for all positive integers n. Since o(Lr) = Le D G, there 
is an element w = $ r;® gj E Ly for which o(w) = 3'7;@a(g;) =v. Choose 
. q so that gr, is an integer for each j. Then we Li N G= Gy and o(qw) 
= go(w) — qu Eo (Qy) which is a contradiction. 

We must now establish the existence of the sets B,D B,D DB. 
Let By be any independent set of generators for the finitely generated free 
group G,. Suppose we have constructed By, D Bye DD By OSt<k. 
Consider G,/Gi,. and the homomorphism Gy Gui —> Ly Lin given by g + Gur 
>g + Lu This mapping is one to one. For if ge@ and g€ Dy, then 
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gE Lua N G= Qu. Thus we see that G,/Gy, is torsion free and we have 
the diagram. 
0> Gm > ho G/ Gi 0. 


Since G,/G,; is a finitely generated free group G, is the direct sum of Gu, and 
another group. Thus the basis Bi, of Gu, may be extended to a basis B; 
of G;. Proceeding inductively in this manner we reach B, and the conclusion 
of the proof. 

We have thus shown that for any endomorphism o of a finitely generated 
free abelian group G there is a basis of G with respect to which o has the 
following form i 


Where r is a square matrix, « is a triangular block 


X 0, 
and there may be non zero entries in the section indicated with a =. We will 
refer to this as a standard form for o and a basis as the one in Theorem 16 
shall be called a standard basis with respect to o. In the case where o is 
nilpotent (o*==0) then in Theorem 16 G,—L,— {0}, and the block r dis- 
appears from the standard matrix form and o has a triangular form. 

We will now examine in more detail the structure of an affine trans- 
formation S == (zo A) of a finite dimensional torus X. We will restrict 
ourselves only to the case where S is ergodic. The results of Section 2 state 
that either {O0}—,(A) for all p=i or {0} 4 Ki(A) =—XK,(A) for all 
p=1. In other words either A has no eigenvalues which are roots of unity 
or A has some eigenvalues equal to 1 but no eigenvalues equal to any other 
root of unity. We recall that A* is an automorphism of the finitely generated 
free group X and state the following obvious remark 


Remark 17. If K,(A) —{0} for all p21 then the number k for 
go = A*— I in Theorem 16 is equal to zero and the standard form of o has 
no triangular part. 

We know that S is strongly mixing and if K,(A) = {0}, then A —T is 
non-singular and there is a point ze R™ with Ar— = — ta Ar+ u =T. 
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Reducing modulo 1 we find that S has a fixed point in the torus and | so it 
cannot be strictly ergodic. 
We now wish to examine the case where {0} 34 K,(A) = K,(A), pet: 


THEOREM 18. If S is ergodic and tf {0} K,(A)—K,(A) and if 
A—TI is nilpotent then A has a standard form 


1 é 
1 and r= | - 
1 3 
and at least é is irrational. Moreover S is strictly ergodic. 


Proof. If A*—TI is nilpotent then Theorem 16 implies that there is a 
basis 61, &,° © `, ên such that 


Are, = 6, 

A’ m a216, + Ea 

A* és = Gg16ı + Qala H 63 ° 

A* Gy = Anı6ı + Ange + + + + annin- + en 


With respect to this basis A* has the form 


1 


and thus A has the super triangular form. The fact that é, is irrational 
follows immediately from the fact that 8 is ergodic and thus by Theorem 8 
To is rationally independent over K,(A). 

In order to obtain strict ergodicity of S we first observe that translation 
by an irrational of the reals mod 1 is strictly ergodic. We use the ergodicity 
of § and Theorem 15 to conclude that 8 is strictly ergodic. 

The affine transformations S == (2,4) also have another interesting 
spectral property when A — I is nilpotent. We recall the following definition 
of quasi-eigenfunctions (see [6], p. 57). Let &, C L,(X) be the set of all 
constant functions. For i> 0 let & C L,(X) be the set of all functions f 
such that Vaf —g:f where ge Ba. The set &, is the set of een 


functions of degree ¢ t. § is said to have quasi-discrete spectrum if U &, spans 
L,(X). 
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THEOREM 19. If S= (7,4) and if A—I is nilpotent then 8 has 
quast-discrete spectrum. 


Proof. From the previous theorem we know the 3 may be written as 
follows l 
zBoat+n 
Ta > É F Aıtı + T3 
Ta — És F Mar Ly F Asa + Ta 
En — En yy + anota + anada Hio + nl + Zu. 


Where the é are fixed real numbers, the a, are fixed integers and the 1; 
_ are real numbers. The transformation is always taken mod-1. 


j 
Let fo(z) =1, f (T, pr, pe- ` ' pi) = exp ( È pei), j= 1,2, ee) and the 
p: are arbitrary integers. If j—1 the functions f(z,p,) are quasi-eigen- ` 


functions of degree one. Suppose we have shown that if j = k the functions 
f (Z, Pu’ + +, pe) are quasi-eigenfunctions of degree k. We observe that 


Vaf (T, Drs" °° Pen) = Cf (2, RP +» Pra). 

Since a constant times a quasi-eigenfunction is a quasi-eigenfunction of the 
same degree it follows that f(z, pu’ > -, Pes) is a quasi-eigenfunction of degree 
k+1. The fact that f, together with all the functions f(z, pu’ p) 
j=1,2,: +, n span L,(X) shows that S has quasi-discrete spectrum. 

The case in which 4 — I is not nilpotent does not allow us.to make the 
assertions of the preceding two theorems. For instance if we let 8, = (2,41) ` 
be ergodic with A,—J nilpotent and if we let S: = A, be a strongly mixing 
automorphism for which some ergodic averages fail to exist [4], p. 586 then 
Sı X 8 is ergodic but not strictly ergodic since some ergodic averages will 
fail to exist. 

Example 20. We wish to give an example of an affine transformation 
S = (2,4) on the three dimensional torus which is ergodic, not strongly ` 
mixing but does not have quasi-discrete spectrum. Let A have the matrix 


1 0 0 y 
0 3 2] and let z—{|{ 0 
0 2 1 0 


where y is irrational. Under these conditions 8 is ergodie but not strongly 
mixing. We also see that A—/ is not nilpotent. The transformation S is 
given by 

T> t ty 

% >37 + 27, 

Te —> BT 2. 
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Let the elements of the form (0, Z2, £3) be denoted by Y and those of 
the form (z,, 0,0) be denoted by X. Let r: Y— Y be given by the matrix 


© i): Then S is given by 
TZ>o+y 
y>r(y) 


and r is strongly mixing on Y. The set $, of quasi-eigenfunctions of degree 
one are the functions of the form f(z,y) —cexp(naz) where n is any integer 
and c is any complex number. If g isin &, then Veg—f-g. Now sinve Vg 
is unitary we have 


(9,9) = (Vag, Vag) = (f9, fg) = (cexp(nz)g (z, y), cexp(nx) 9 (z, y) 
rn cö(g, g) . 


Thus we bave |c|==1 and the quasi-eigenvalue f has modulus 1. We wish 
to show that =, and consequently &,— 8: for p=1 Since &, does 
not span L;(X X Y) this would show that 9 does not have quasi-discrete 
spectrum. Suppose g € &, then 


9 (2,4) — 2 ale)é(y) 
where the sum is taken over ¥ and 
ac(z)— f saw 
Thus Veg(z,y) = Dar + y)&lr(y)). Since g € $? we have 
Fsg (s, y) =f (2) 9 (2,9) ale) F(z) E(y). 
Comparing coefficients we obtain 
(ty) =ar" (2) f(z). 
Since |f(z)| ==1 and r* has all infinite orbits on Y except in the case where 
§=1 and S| æ |? < +o we see that ag—0 if ¢;41. This shows that 
© gay) ale). 
But now it is easy to see that a,(z) is RN %, since we need only examine the 


rotation oc +y Thus $, = ĝa 


5. The theorem of H. Weyl. In this section we will apply the results 
of Sections 2 and 4 to prove a theorem of Hermann Wey! on uniform dis- 
tribution [8]. We say that a sequence of numbers x, is uniformly distributed 
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modi if for each continuous complex valued function f, which also has 
period 1, we have 


N- 1 
lim 1/N X f(a) = f f(x) de. 
N n=0 Jo 


Theorem 21 (H. Weyl). Let g(2) = an" + maz"? +--+ -+a,2-+ to be 
a real polynomial with a,,540 and m > 1. If there is an 1540 for which a 
is irrational then the sequence g(n), n= 0,1,2,---, is uniformly dis- 
tributed mod 1. . A 

It is not difficult to see that it suffices to prove the theorem for the case 
where am is irrational. Suppose the theorem were true whenever the leading 
coefficient of q is irrational. Let 


q(t) = amani +: ta@4+:''+0 


and suppose a; is the first irrational coefficient. Choose M such that Mam: 
Manz‘ ` `, Way. are integers. Each integer n may be written n = kM +s, 
s—=0,1,---,if—1. We wish to show that q(kM +s) is uniformly dis- 
tributed in & for each integer s—0,1,2,--+-,M—1. This follows from the 
fact that q(kM + s) is congruent mod1 to a polynomial of degree j whose 
leading coefficient is irrational. Now it is not difficult to see that q(n) is 
uniformly distributed. 

We will prove this reduced form of the theorem. In order to prove this 
theorem we will construct a strictly ergodic affine transformation of the m + 1 
dimensional torus one of whose coordinate sequence is given by an arbitrary 
preassigned polynomial of degree m with leading coefficient irrational. Let 


o 0 
é= | : | andletA—[? , 
0 0 i 4 


and let S = (é, 4). That is $ is the transformation of the m + 1 dimensional 
torus given by 

Ly—> Ly +y 

Tı > T1 + To 

T2 > To F Tı 

Em > T: F T. 


The reader should be warned that for simplicity of expression I have 
taken A in sub diagonal form where as in the previous theorems it was in 
super diagonal form. This of course does not alter the arguments. We must 
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study the form of the powers of A and we give our results in the next two 


lemmas. 
LEMMA 21.1. If Ar (Or) for n=0,1,2, >: then A" is symmetric 
about its secondary diagonal. That is O”m-j,ma = 0"; 


Proof. The statement is true if n—0. Suppose it is true for n—1. 
Since A" == A: Á”! == A" 14 we obtain 
Ag ORT HOt Ost + On 
Applying this formula and the induction hypothesis we obtain 
C Cnt + Ont 


adit = m-Gr1),m-4 m-J,m-t 


ma (0-1 + or = O 


ijl 43° 


For our purposes we must also compute the entries of the first column 
of A". We consider the infinite array 


ı 117171 

012 3 4 6 
0 0 1 3 6 10 
0 0 0 1 4 10 
000015 
00000 1 


whose law of formation is po(j) =1 for 720, p(0)=0 for +>0 and 
pj) =p (i — 1) +Mmalj—1) for +>0 and j>0. Where i is the row 
index and 5 the column index and 1,j==0,1,2,-- +. Observing that this 
array is merely Pascal’s triangle we also obtain 


Po(j) = 1, j= 0,1,2,° Peta, teem 1,2, 3,° ii 


(GoD Git 


i! 





PG) = 
Consequently in all cases we see that p;(7) is a polynomial in 7 with rational 
coefficients and degree 7. Another fact that we will use later is that 


oo . j= 1,2,3,° °° 
* k) = Du for 7 993 
o Soe) <p) er IR 


Lemma 21.2. If Ar (Cr) then O” == p(n) for t=, 1, 2," “+m 
and n =0, 1,2, +. 


j= 0,1,2,3 i=, 38 
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Proof. The statement is true if n—0 and the induction follows imme- 
diately from the two formulae 


Catt, o == ON + Oro 
p(n + 1) = pua (2) + p(n). 


We now prove Theorem 21. Let q(2) = anı2"" + 4m2” ++ az-+ dy 
where am is irrational and m `> 0. Consider the transformation S == (p A). 
For any T == (T3, T4 © ' `, Em) we have 


8" (at) = Éo + Ago + A É H Art +4 Ate. 


IE yr == (y"o, 915° y 49%) = 8" (£) we wish to compute y*m. From Lemmas 
21.1 and 21.2 and the formula (*) we see that 


Y'm = y (Pm (0) + ml) + pm(2) +° © ++ Pm(n—1)) 
+ opm (n) F Pma (n) H: > F Empo (n) 
= YPm (N) H Lopm(%) + BPm (0) +: 4 Empo (m). 


Since the degree in n of each polynomial p; is j and since each polynomial 
has rational coeffieients there is an irrational number y and real numbers 
To Ti,” * "52m for which 
q(t) = Y'm- 
Now it follows from Theorem 15 that S= (&,4) is strictly ergodic. 
This implies uniform distribution of the points S"x for each x. In particular 


if f is a continuous function on m+-1 space with period 1 in each variable 
we have 


N-1 1 1 
lim 1/0 $ f(8*2) — Í TE Í EE D ETEN M 


If g is a continuous function of a single variable and has period one 
we let f(z) =g (2m). We then have 


N-t N-1 1 
lim 1/N $ g (y'a) = lim 1/N X g(q(n)) = f 9(2)ds 
N n=0 N n=0 o 


which concludes the theorem. 


I would like to point out that all the affine transformations S == (z, ÁY. 
where A has diagonal form may be imbedded in the nilflows of [3]. In fact 
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in Chapter VIII of [3] L. Auslander and the author used a certain nilflow 
to prove a theorem similar to the Hermann Weyl theorem. Our model there 
was different from the one used here and we obtained a slightly weaker theorem. 


YALE UNIVERSITY. 
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FINITE RINGS HAVING A CYCLIC MULTIPLICATIVE GROUP 
OF UNITS.* 


By Ropurt W. Grummer, JR. 


This paper determines all finite commutative rings R with identity such 
that the multiplicative group of units of R is cyclic. The method of proof 
is straightforward, though the details sometimes become involved. We easily 
reduce the general case to that of determining all finite primary rings which 
have a cyclic multiplicative group of units. If S is such a primary ring, if 
g generates the multiplicative group of units of S, and if Sy is the subring of 
8 generated by the identity element e of S, then we can show that § = So[g]. 
Therefore § is a homomorphic image of S,[X] and of Z[X]. In the case 
when Ss=@GF(p) for some prime p, So[X] is a principal ideal domain 
whose ideal structure is well known. If S, is not a field, we consider $ as 
a homomorphic image of Z[X]. The final result obtained is: 


Each of the following classes consists of finite primary rings R having a 
cyclic multiplicative group of units. Any finite primary ring with a cyclic 
multiplicative group of units is isomorphic to an element of one and only one 
of these classes. 


(A) GF(p*). 
(B) Z/(p”) where p ts an odd prime and m > 1. 
(C) 4/(4). 


(D) W,[X]/(X*) where p is prime and I, = GF (p). 
(E) W,[4]/(4*). 
(F) Z[X]/(4,2X, X?—2). 


We shall use | A | to denote the cardinality of a finite set A. If Risa 
ring with identity, Gg will denote the multiplicative group of units of R. 


THEOREM 1. If R isa finite commutative ring with identity, then R is 
a direct sum of primary rings R,,---,R, and Gr ts a direct product of 


* Received July 19, 1963. 

1 This research was supported by the Office of Naval Research, Grant NONR(G) 
00089-62. The author wishes to thank Professor C. W. Curtis for suggesting this 
problem to him. f 
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Gry > Gr. Gp ts cyclic if and only if each Gp, is eye and (| Gn, | Ga, |) 
=] for 1Si<jsk j a 


Proof. Since R is finite, R satisfies the descending chain condition and 
is therefore a direct sum of primary rings. [4; p. 205, Theorem 3]. If 
7 mm Dr; where t; € F, we may easily show that r is a unit in R if and only if 
„isaunit of F; for allt. Thus Gr = Qr,- `- Gr, The last assertion 
follows from elementary group theory. 

Theorem 1 reduces the problem of finding all finite commutative rings R 
with identity such that Gr is cyclic to the problem of determining all finite 
primary rings with this property. . 


Lemata 1. If Risa finite commutative ring with identity such that Gr 
is cyclic and if f is a homomorphism from R onto a ring S, then f induces a 
homomorphism from Gp onto Gs. In particular, Qg ts cyclic. i 


_ Proof. We first suppose that R is a primary ring with maximal ideal W. 
In this case Gr = R — M = {g*},.." for some gE Gr. If S— (0), the lemma 
is true. If S4 (0), the kernel A of f is contained in M. If me M, then 
f(m) €f (M) C 8 so that f(m) is not a unit of S. Therefore if s = f(v) € Ga, 
then v € Gpr so that v = gt and 8 == [f(g)]* for some integer i. The assertion 
then follows in case R is a primary ring. 
In the general case R = R, @ >- - @ R, is a direct sum of primary rings. 
We suppose g = > g; where g; € R; and g generates Gp. Now 


|@r| = [D] =) > ga) |= | Gr l] Gr, l: 


Since | (g:)| S| Gr, | for each i, | (g1) | = | Gr, | for each i so that g, generates 
Gp, Tf A is the kernel of f then A—A,@---@A, where 4; = AR, is 
an ideal of R Also S = R/4 = (#,/A1) D- © (Ru/An). By the pre- 
ceding case Gra; is cyclic and is generated by ĝ Further, | Griya, | is a 
divisor of |Gr,| so that (| Grua l| ra|) =1 for ISi<jsn. 
Theorem 1 now implies that Gs is cyclic and is generated by $ f(g) =f (È A) 
== f(g). This completes the proof. 


THEOREM 2. Let S be a finite primary ring with maximal ideal M. 
For some prime p, |S|—=p*. If S, ts the subring of S generated by the 
identity element e of S, and tf g generates Gs, then S=S,[g]. Hence 8 ts 
a homomorphic image of S,[X] and therefore also a homomorphic image 
of 2[X]. 


Proof. S/M is a finite field of characteristic p for some prime p. Thus 
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pec M and (pe)*=pte—0 for some keZ. This implies pa—=0 for all 
a€ 8 so that considered as an additive group, S is a p-group and | 9 |= p° 
for some s. [1, p. 43]. 


Evidently So[g] contains every unit of 8. If me M, then m-+g¢ M 
so that m -+ g — g* for some i and m == gt— g € S,[g]. Therefore S==S,[9] 
as asserted. The last part of the theorem is obvious. 

Theorem 2 greatly simplifies the problem under consideration for it shows 
we need consider only residue class rings of S,[X]. An important special 
case is when So = H, for then I,[X] is a principal ideal domain. Theorem 3 
determines all finite primary rings of characteristic p which have a cyclic 
multiplicative group of units. 


-- THEOREM 3. Suppose R is a finite primary ring of characteristic p and 
with maximal ideal M. Let |M|=pr and |R|== p**. Suppose further 
that g generates Gp and the homomorphism f: I,[X]—>R is defined by 
RX) =S ag’. The kernel Q of f is a primary ideal and VO=P is 
mazimal. In fact, P—=(q(X)) for some irreducible polynomial q(x) of 
degree k, and Q = (q"(X)) for some integer n. 


The following statements hold: 
a) tf n= 2, then k==1. 


b) nS3 and if n=3, p==2. Consequently, it is necessary that either 
R is a finite field, R= U,[X]/(X*), or p=? and R= U,[X]/(X*). This 
condition is also sufficient in order that R be a primary ring of characteristic 
p for some prime p and that Gp be cyclic. 


Proof. By Theorem 2, f is onto so that R = I,[X]/Q. Thus Q is 
primary and P is maximal because R is a primary ring. That P= (q(X)) 
and Q = (q*(X)) for some n then follow because I,[X] is a principal ideal 
domain. We have R/M=1,[X]/P and|R/M|—p*. But |11,[X]/P|=p* 
where s is the degree of g(X). Hence sk. 

If n=], R is a finite field. Now suppose n2=2. If a,b€ I, then 
[1 + (a+ bX) qr*(X)]*==1 (mod Q). For k= 2, this gives us p?—1 units 
of R of order p. Hence k=1. Without loss of generality we can take 
g(X) =X. Now if (n—2)p=n, then [1+ (a+ bX)X"*]?==1 (mod Q), 
which again gives us p?— 1 units of R of order p. Therefore n > p(n—2) 
= 2(n—2) so that n< 4 and if n==3, p—2. This proves statements a) 
and b) of the theorem. 
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It is well known that Gp is cyclic if R is a finite field. If 
R=1,[X]/(X°), |Gz|—4 and 1+ 2 has order 4. If R—-U,[X]/(X?), 
1-+-X has order p and for some element ¢ of Ilp, # has order p— 1. Hence 
t(1+X) has order p(p—1) =| Ga]. 

We now turn to the case of a primary ring R of characteristic p” where 
m> 1. In this case it will be important to consider R as a homomorphic 
image of Z[X]. 


THEOREM 4. Let R be a finite primary ring of characteristic p”, m > 1, 
such that g generates Gr., If p is an-odd prime Rex Z(p"). If p=2, then 
either Rox Z/(4) or Rex Z[X]/(4, 2X, X?— 2). 


Proof. Let p: Z[X]>R be the homomorphism defined by p(X aX*) 
= Sag. The kernel Q of p is a primary ideal containing p” and its radical 
P is a maximal ideal containing p. We have 


Z/p"Z =Z/(Q N Z) = (Q+2)/Q—SEC4[X]/Q=R. 


We identify R and Z[X]/Q. 8 is a primary ring and Gg is the unique sub- 
group of Gz having order p”*(p—1). In particular, every element of 
Gp having order a divisor of p™-*(p—1) is determined by an element of Z. 
Moreover, Gg is cyclic so that p is odd or p=m=—2. [3; pp. 114-5, 
Exercises 4-6]. ] 

We next wish to show pr— qE Q for some g€Z. This will greatly 
simplify the process of determining a complete set of residues of Q in Z[X]. 
We consider b = (pX +1)?"". We shall show b==1(modQ). To do so it 
suffices to show all coefficients of b— 1 are divisible by p®. This follows 
immediately by induction on m. Hence pX + 1 has order p” mod Q for some 
r<m—1i1. As shown previously, this implies pX +1==z(modQ) or 
pX — qE Q for some qE Z. Now pX — q€ P implies q = pc for some integer 
c. Since p(X —c) c Q and pé Q, X—cE€ P. It follows that A = (p, X —c) 
CPCZIX]. A, however, is maximal in Z[X] so that P = (p, X — ©). 
Further, as we have just shown, p(X —c) € Q. 

If q(X) is a monic polynomial of minimal degree in Q and if g(X) has 
degree s, then modulo Q, every element of Z[X] may be reduced to the 


8-1 
form $ Xt where (a, ' -,d:} C {0,1,- - -,p—1} and 0 S a p™—1. 
i=0 


(Noting that pX®=pc®(Q).) Further if a—=DaXteQ, then each a; = 0 
for if a0 for some i>0, we would obtain a contradiction to the mini- 
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mality of s since a; is then a unit modulo Q. Then a= a€ Q so that a—0 
also. Therefore | Z[X]/Q | = p™**+ in this case. Further if 
8-1 a-l -1 
E uX —p( SOX) — WXtQ== I (u— phi) XE Q, 
=o i +=0 4=0 
then y—0 for +> 0 and p divides a. This observation shows that the set 
-1 
of all elements Tarı where {4} C {0,---,p—1} is a complete set of 
ár 


residues of the ideal Q + (p) in Z[X]. Thus Z[X]/Q + (p), being a homo- 
morphic image of Z[X]/Q, is a primary ring of characteristic p, has order p°, 
and has a cyclic multiplicative group of units by Lemma 1. By Theorem 3, 
Q + (p) = (p, (X—c)*) for some integer n. Since 


p? =p = | Z[X]/ (p, (X¥—e)*)|, 


n==8 so that (X — c)’ ==a(X)-+pb(X) for some a(X) €Q, b(X) € Z[X]. 
Therefore, (X —c)*==py(Q) for some y€ Z. We have now shown that 


(pr, p(X — 6), (X—c)*—py) —BCQ. 


However, it is clear that | Z[X]/B|<p™**+ so that Q—B. We note also 
that (X—c)[(X—c)*— py] = (X¥—c)**— yp(X—c) =0(Q). Thus 
(Z —c)"1=0(Q). 

We have already seen that if s=1, R = Z/ (p). We now assume that 
$> 1. We then observe that 


> Cae [ (x — c) + 69” = (X — ce)" + cent? cpm? (mod Q) 
because p™*?>s+1 and p(X —c)=0 (mod Q). Further 
Ares p jf pment > gt 1. Now p™8 > pm- go that p™-!(p—1) 


divides p™***(p—1). Because c determines a unit of Z/(p™) (Note 
c== X5£0 (mod p).), : 


P~- == 1 (mod Q). Thus 
ED =] (mod Q) or cr" == or" (mod Q). 
It follows that X?™**? == Xe" (mod Q) or 
Zoe) — T= 0 (mod Q) if pur >s +1. 


However, P has index p in Z[X] so that the multiplicative group of 
units of Z[X]/Q has order p™**-?(p—1). Since g generates G we conclude 
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that p+ < 84-1. But for p prime and m and s= 2, this is possible only 
Up =m =8 =? . |. i 

Therefore, either R= Z[X]/(4,2X,X?—2) or R= Z[X]/ (77, 2X, 4). 
One can verify directly that the multiplicative group of units of the first of 
these two rings is cyclic, while that of the second ring is not. 


Remarks. 1. A finite ring R with identity such that @ is cyclic need 
not be commutative. We may take R to be the collection of 22 upper 
triangular matrices with entries from I. 


2. If R is a finite commutative ring with identity such that g generates 
Gp-and if R, is the subring of R generated by the identity e of R, it need 
not be true that R == Ro[g]. That is, not every element of R need be a sum 
of units. R= D, @ I; is such a ring. 
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A GENERALIZATION OF A POINCARE-BENDIXSON THEOREM 
TO CLOSED TWO-DIMENSIONAL MANIFOLDS.* 


By ARTHUR J. SOHWARTZ. 


Introduction. We shall consider a ©? action of the real line, T, on a 
compact, connected, two-dimensional manifold, M, of class C*. Thus a: 
TX M—M is a transformation of class O? such that im==a(t,m) satisfies 
(t+ s)m = t(sm) and Om==m. Note that C? vector fields on M give rise 
to such actions (see, fo rexample [5, p. 40]). A set, QC M, is called a- 
minimal if it is closed, invariant under « (TQ—Q), non-empty and contains 
no such proper subset. 

The purpose of this paper is to prove that any minimal set is either a 
ixed point, a homeomorph of S*, or 1 of M and homeomorphie to T”. 
This theorem is an extension of work by Poincaré [Y], Bendixson [1], and 
Denjoy [2]. In particular, the analytical methods of Denjoy are modified, 
extended, and to some degree simplified. A theorem equivalent to this was 
stated by Haas [3, p. 297]. However, as Peixoto pointed ont [6, p. 118], 
the accompanying proof was incorrect. 

The author wishes to acknowledge his indebtedness to Professors R. Sack- 
steder, E. Lima, and R. Ellis fo rtheir criticism and encouragement during 
the preparation of this paper. 


Tueorem. Let M be a compact, connected, two-dimensional manifold 
of class O°. Leta: TX MM be a OC? action of the reals on M. Let Qc M 
be an a-minimal set. Then Q must be one of the following: a) a singleton 
consisting of a fixed point; b) a single, closed orbit homeomorphic to St; or 
c) all of M which is homeomorphic to a torus T?. 


Proof. Let Q C M be an a-minimal set. Then Q may be either 
(a) {v}= To, ie, a fixed point; 
(b) an orbit, y, which is homeomorphic to S?, i.e., a periodic orbit; or 


(c) a set which contains neither fixed points nor closed orbits. 


* Received April 23, 1963. 
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Q cannot be anything else since fixed points and closed orbits, being non- 
empty, closed, and invariant may not be properly contained in a minimal set. 
Case (c) may be subdivided as follows: 


(c’) Q has non-empty interior. In this case, since the set of interior 
points is invariant and Q is minimal, the set of boundary points must be 
empty. Thus Q is open and closed and must be all of M. It follows from a 
result of Kneser [4, p. 153] that since M contains neither fixed points nor 
closed orbits it must be homeomorphic to T”. 


(C”) Q has empty interior and, being closed, is nowhere dense. 


Since (a), (b) and (c’) are precisely those cases which are possible 
according to the conclusion of the theorem, it remains to show that (c”) 
cannot occur. 


Let i: [—1,1] > M be a C? imbedding such that’ 

(a) Z=i((—1,1)) is transverse to every orbit intersecting it; 

(b) i(—1) and i(+ 1) are not in Q; 

(c) (0) isin Q. l 

I may be used as a local cross section; i.e., there exists o > 0 such that 
for |s|<o and |t| <1, ö(s,t) —si(t) defines a diffeomorphism. We may 
thus take &-* as a coordinate system at 1(0). 

The proof of the theorem turns on the behavior of a function, f(r), 
induced by “the first return of the orbit through r€ I to I.” We define this 
function as follows: 

Let 

U — {rE I | 3t > 0, tze I} 
and for each ze U 
te—min{t | tze I,t> 0}, 


then for ver!(U)=V C(—1,1), we define 
fo) =i (tyo)t(v) ). 
Note that for | v—v,| sufficiently small, 
F) =r (8*(tcot(¥))), 


where (é, n) =n, and therefore f€ C?(V). Since Q is minimal, for cach 
vE Q and real number N, oy = cl{to | w€ N} =Q if “cl” denotes “closure.” 
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In fact, since M is compact, [} oy for N = 0 is a closed, invariant subset of Q. 
Thus 
Q=it(IND)CV. 


It is also true that G is a perfect, nowhere dense set. Letting W be open in 
(—1,1) and such that EC W C WC V, we summarize the properties of f: 


(1) d= (—1,1)—U (wb) CW, 

(2) f: W> (—1,1), 

(3) f(G) =Q, 

(4) _ f(g) =g and ge G implies k= 0, 

(5) O<LS|f(w)| SF for al we W, 0<L<1<F, 
(6) - | f’(w)| SM for all we W. 

(7) G is B-minimal, where B (k, g) =f! (g). 


We shall prove the theorem by showing that no function satisfying (1)-(7) 
exists. 
Let p= dist(G, (—1,1) —W). We now prove: 


Lemma 1. There eatsts a complementary interval (a,b) such that 
a<b; a, bE G; and f*((a,b))C W for all k20. 


Proof of Lemma 1. Let S=={i|b—a=p} and Y == {u b| iE 8). 
Note that S and Y are finite sets. Thus it follows from (4) that there exists 
N such that f*(a,)¢ Y for kÆ N. Since f preserves endpoints of comple- 
mentary intervals, fN (a) == a, or b; for some i. Then, according to the choice 
of N, | f(a) —fe(ds)| <p for all 420. Then setting (a,b) = (a,b;), we 
have an interval with the required properties and the lemma is proved. 

Using the symbol D to denote differentiation, [Dg](z) =g (z), we 
verify the following: 


Lemma 2. Let N be an integer and [p,g]C (—1,1) such that. 
f*(Le,q]) C W for all k satisfying OS kN. Then 


(8) FH (p) (lg) = D (w) - (p— a) 
for some wE (p,q); 
(9) LDP (u)|- Deren — PO 


for all k satisfying OS k SN and u, vE [p,q]. 


g 
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Proof. Formula (8) is derived by applying the mean value theorem to 
fe, Next, since Df! (u) = I Df(fi(u)), 
logl| Df (u) | | Dfe (0) |=] 
< Š Jog D(f (u)) —log DFC (o) | 
=$ | Djun [A | Dwn) Fu) POL 
which implies (9). 
Next, we note that Lemma 1 implies that 
(10) 3 Dpef) S2(0—a)7 
for some {wz} C (a,b). Employing (9) and (10) we derive 


(11) o~ 3 Df*(a) <2(b—a)*exp[2ML*]. 
Now set - 


(12) v= pL[6(o+1)(M + 1)]*. 


We now Bee that for any z in N (») U | |y—a|<v} and any natural 
number k, 


(13-%) | (2) —F*(a)| <p 
ae | 
(14-6) |Dr@)l<e| Df*(a) 


We note first that (13-0) and (14-0) are trivially valid. Suppose (18-4) and 
(14-4) are valid for 0O<k=SN. Then according to (9), (8), the induction 
assumption, (11), and (12), respectively, we have 


Dp (a) || DP (a) |S exp[MT= $ | (e) — f(a) |] 
< oxp[ MI > Df (ux) -v] Sexp[MI-e-o-v] < e, 
since ML-!eoy < eu/6 < #=1. (14%) and (8) imply (13-k) and the asser- 


tion follows by induction. 
Now (11) and (14) imply that lim Dfk(z) —0, ko, uniformly for 
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zin N(v). Moreover, uniform convergence holds for z in PP (N (vs) N G) since 
| Df*(fe(x))| S FlelL-lel | Df*(x)|. Since 


K =U {P(N (v) N G)|—o<p<%} 


is a non-empty, open invariant set in G, and @ is B-minimal, K = G. Since 
G is compact, we have 


(15) lim Df*(z) == 0 uniformly in G. 
k> o 


However, our analysis applies equally well to f* and we must therefore 
have 
(16) lim Df*(z) = 0 uniformly in G. 
ko 


Together, (15) and (16) imply that for some N, Df¥(x) <4 and 
DFN(fN(2)) <4 which is absurd. Thus the theorem is proved. 


Application to Poincaré-Bendixson theory. The “classical” Poincaré- 
Bendixson theory is concerned, in large part, with the study of o-limit sets 
which are defined as follows: 


Definition. Let p be a point in M3, then the w-limit set of p is 
Op = {q | At, tp > q}. 
It can be shown in a straightforward manner that Qp = N d{tp| t2 N}; 
Nea 
whence we may deduce that Qp is closed, invariant, and non-empty. It follows 


from an application of Zorn’s lemma that Qp contains at least one minimal set. 
Next we introduce the notion of “winding” in a precise fashion. 


Definition. A transversal, IC M*, is a differentiable homeomorph of 
. [0,1] such that no orbit of a intersects I tangentially. 


Definition. We say tp winds toward Qp in case for every gq in Qp, there 
is a transversal, Ig, containing q in its interior such that successive inter- 
sections of {tp | t= 0} with Iq tend monotonically toward q. 

We may now prove the following “ Poincaré-Bendixson type” theorem: 

COROLLARY. Let M° be an orientable manifold. If M? is not a minimal 


set under a C? action, a, and Qp C M? contains no fired points, then Op S* 
and tp winds toward Qp. 


Proof. QP contains at least one minimal set, $. From the preceding 
theorem it follows that 3 = 8+. We may construct, around 3, a neighborhood, 
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K, consisting of a union of transversals, which is homeomorphic to a cylinder, 
(—1,1) X S+. It follows from the continuity of a, and the fact that $ C Qp, 
that there exist 0 < t, < te, q E€ Qp, and Iq a transversal through q such that 
tap is between tıp and q on Ig. Thenceforth tp is “trapped” between the 
closed curve formed by [t t:]p and the portion of Ig between tip and tap 
and 3. Thus we find the next intersection of tp with Iq between tp and q. 
Repetition of this argument yields the conclusion of the corollary. 


PRINCETON UNIVERSITY. 
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SIDE APPROXIMATION, MISSING AN ARC.* 


By Davo 8. GILLMaAn.! 


I. Introduction. Much topological study has been devoted to em- 
beddings of 2-spheres in Euclidean 3-dimensional space Æ. By a 2-sphere, 
we mean any homeomorphic image of the boundary of a 3-cell. The 2-sphere 
S is said to be tamely embedded in H* (or simply tame) if there is a homeo- ` 
morphism Ah of E° onto itself such that h(S) is a polyhedron (the sum of a 
locally finite collection of tetrahedra, triangles, segments, and points). If 8 
is not tame, then 8 is called wild. Tameness and wildness may be defined 
in this manner for any closed subset of Er. In 1926, Alexander exhibited 
the first example of a wild 2-sphere in F? [1]; many examples have appeared 
subsequently. 

Indeed, these examples illustrate that a 2-sphere embedded in E? may 
have many surprising characteristics besides that of wildness—it may have 
several points at which it cannot be pierced by a tame arc [11]—it may well 
have some subarcs which are wildly embedded in E®, as does the 2-sphere 
of Alexander—it may have all of its subarcs tamely embedded, although the 
2-sphere itself is wildly embedded [5]. 

On the other hand, recent results of Bing severely limit the amount of 
pathology that may occur in a 2-sphere S in E®. It is now known that § 
must contain many tame arcs [6]; it also must contain many points at which 
it can be pierced by a tame arc [7]. Bing established these properties by 
repeated use of his Side Approximation Theorem [8], which we call Theorem 
1. It say the following: 


Tuxormm 1. If 8 ts a 2-sphere, U is a component of E°— 8, and e> 0, 
then there is a polyhedral 2-sphere 8’, a finite collection D, Da: + >, Dx of 
mutually exclusive disks N in S’, each of diameter less than or equal to «, 
a finite collection Hy, Ea’ - +, Hm of mutually exclusive disks lying in S, each 
of diameter less than or equal to «e, such that 


1. there ts a homeomorphism of 8 onto 8’ that moves no point by more 
than «e (henceforth abbreviated H(8,8’) Se). 


*Received July 5, 1963. 

* This paper formed part of the author’s dissertation at the University of Wisconsin 
under the direction of Professor R. H. Bing. This research was supported by a National 
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k 
2. V—DdD,CU. 
2 4-1 
3. S id Ss’ C DE. 
+1 


It would seem, then, that the subdisks H,, H2,- © ',E„ are, in some sense, 
the “bad” points of ©. This provides the motivation for the main theorem 
of this paper, a characterization of tame arcs in Æ’ (Theorem 10). This 
theorem states that a necessary and sufficient condition that an arc A, lying 
in a 2-sphere S in Z®, be tame is that Theorem 1 is still true for S with the 
additional condition : 


4, ASE =. 
4=1 


What are some of the possible applications of this theorem? Consider 
the following questions raised by Bing: 


Question 1. If A is a tame arc lying in a 2-sphere 8 in FE’, can $ be 
pierced by a tame arc at each point of A? [7] 


Question 2. Suppose Y is the set of points of 8 at which S cannot be 
pierced by a tame arc. Is Y an 0-dimensional F, set? [7] 

In the course of this paper, both questions will be answered in the affirmative. 
We now outline the arrangement of the material to follow. 

In Section IT, only the necessity of the condition characterizing tame arcs 
is established, this being done in Theorem 2. The main purpose of the third 
section is to develop, via Theorem 2, a characterization of the piercing points 
of a 2-manifold in E®—a 2-manifold can be pierced by a tame arc at p if 
and only if there is a tame arc lying in the 2-manifold and containing p. 
Note that one direction of this result answers Question 1 in the affirmative. 

Sections IV, V, and VI are devoted primarily to a proof of the sufficiency 
of the condition characterizing tame arcs. Once this result is established, it, 
` together with the piercing point characterization of Section III, is then used 
to yield an affirmative answer to Question 2. The best previously known 
result in the direction of Question 2 was given in m, showing that the set 
Y lies in a 0-dimensional Gs subset of 9. 


II. Side approximation, missing a tame arc. We make the following 
definitions : 


The interior of a 2-sphere S, abbreviated as /ntS, is the bounded com- 
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plementary domain of 8. This term will also be used in another sense, namely, 
the interior of a disk D, abbreviated as Int D, consists of the points of D not 
lying on the rim of D. 

The distance between two sets V and W will be denoted by dist(V, W); 
the diameter of a set X will be denoted by diam(X). 

An e set is a set of diameter less than or equal to e. 

A set X is locally polyhedral at a point p of E” is there is a neighborhood 
N of P such that Ñ: X is a polyhedron in F”. 

A set X is locally tame at a point p of E”? if there is a neighborhood N 
of p and a homoeomorphism h of N into E® such that h(N-X) is a poly- 
hedron in F°. , 


Trreorem 2. If Sis a 2-sphere in E®, A is a tame arc lying in 8, U is 
a component of E®—8, and «>0, then there is a polyhedral 2-sphere 8’, 
a finite collection Dy Da,‘ +, Dy of mutually excluswe «e disks lying in 8’, 
a finite collection E,,H.,:+-+,EHm of mutually exclusive e disks lying in S, 
such that 


1. H(S,8’) Se. 
k 

2. S—EDCU. 
4=1 


3. S-F CSE 
= 
4, ASE. 
= 


Proof. Observe that Conditions 1, 2, and 3 of Theorem 2 are those of 
Theorem 1: The main tool employed in this proof is a strong form of 
Theorem 1, namely, the Side Approximation Theorem on Open Subsets, estab- _ 
lished in [8]. For convenience we assume that the component U of #*—S 
is Int 8. . 

Given «> 0, we assume that S has diameter greater than 2e and that 
there is a point p of Int $ whose distance from 8 is more than 2e. There is | 
a 38> 0 such that if f is a homeomorphism of $ moving points less than 8, 
then any ô subset of f($) will lie on a disk in f(8) of diameter less than e. 

We now invoke the Side Approximation Theorem for the open set S-— A, 
and for the positive number 8/2 (Theorem 18 of [8]). This tells us that 
there is a homeomorphism g defined on S such that 


a. g is fixed on A. 
b. g moves points. less than 8/2. 
c. g(S). is locally polyhedral, mod A. 
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d. g(S—A) lies, except for an infinite collection D,*,D,*,---, of 
mutually exclusive 8/2 disks, in Int 8. 

e. S—A lies, except for an infinite collection #,*, E,*,- - -, of mutually 
exclusive 8/2 disks, in Extg($). 

f. Both collections of disks are locally finite, mod A. 


Since the 2-sphere g(S) is locally polyhedral, mod A, where A is a tame 
arc, it follows that g(S) is tame [10]. Thus, by [2], there exists a homeo- 
morphism k of E! onto itself taking g(S) onto the unit sphere R. 

Let « be a homeomorphism of Æ? onto itself which is the identity 
except in a small neighborhood of R, and which contracts R slightly, i.e. 
a(R) C Int R. We choose « to move points a sufficiently small amout so that 
the homeomorphism [kak] moves points less than 8/2. The 2-sphere 
S’ == [ktak]g(8) will now be shown to satisfy Conditions 1-4 of Theorem 2. 
Of course, 8’ may not be polyhedral; this will be attended to later. 


1. By its very definition, it follows that 8’ is homeomorphically within 
8/2 + 8/2 =ð of §. Since §<.«, Condition 1 follows. 


The proof that 8’ satisfies Condition 2 will be deferred until after the proofs 
of Conditions 3 and 4. 


3. 8’ — [k>ak]g(S) is contained in Intg(S). Thus, Property e above 
implies that 


S—A—D EF? C Ext”. 
1 
Furthermore, since A C g(8), we may strengthen this to 
S—S EMC Exts. 
41 
Since the disks #,*,#,*,- - +, converge to A, there is an integer N 
such that 
N 
S—Dd FE? C Ext 8’. 
i 
Thus, the disks #,*, H,*,- - -,#y* satisfy Condition 3. 
4. The disks #,*, #,*,- - -, Ey” were selected to lie in S—A, so Condi- 
tion 4 is immediate. 


2. Any component of S-S’ is a 8 set, since it lies in a disk #,®, which 
is a § set. Furthermore, since S’ is homeomorphically within 6 of 8, 
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it follows that every component of S- S’ lies in a disk in 9’ of diameter 
less than e. 

Let Di, Datt ts D; be a finite collection of mutually exclusive 
e disks in 9’ such that 


k 
END 
{a 


That there exists such a collection is shown in Theorem 9 of [8]. 
Furthermore, 


È 
Z —> D, Cc Its.. 
= 


The last relationship may be seen as follows: Note that p lies in Int 9’, 
since 8’ is homeomorphically within ê of 8. This is a consequence 
of Theorem VI13 of [13]. Select a point q lying in Ext8’ such 
that the distance from q to S + 8’ is greater thane. Thus, by Theorem 
14 of [8], there is an are pq with end points p and q such that 


The first point of [S — £ Dı] + [S —> E*] on pq in the order from 
p to q is a point of & since 


N 
S— DEC Ext. 
4=1 


Moreover, this point must lie in Int S, since p was chosen to lie in 
Int S. The desired relationship follows, completing the proof of 
Condition 2. 


Thus, the 2-sphere 9’ satisfies Conditions 1-4; however, although S’ is tame, 
it is not necessarily polyhedral, as we would like. This may be remedied by 
use of [8] or [4], choosing a polyhedral 2-sphere sufficiently close to 8’ so 
that Conditions 1-4 remain true. This completes the proof of Theorem 2. 


A Sterpinskt Curve X is the set obtained by removing from a 2-sphere 
the interiors of a sequence of mutually exclusive disks, dense on the 2-sphere, 
and with diameters.converging to zero. The boundary points of these disks 
are called accessible points of X. The remaining points of X are called 
inacccesstble. 

It is known that any two Sierpinski Curves are homeomorphic. 

The main result established in [6] is the following. 
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THEOREM 3. For each 2-sphere S in E° and each positive number e 
there is a Sierpinski Curve X in 8 such that 


1) X lies in a tame 2-sphere, and 
2) each component of S—X is of diameter less than e. 


This result is established in [6] by repeated use of Theorem 1. By 
making repeated use of Theorem 2 in place of Theorem 1, the methods of 
[6] establish the following stronger result. 


THEOREM 4. If A is a tame arc lying in a 2-sphere S in E?, then for 
each positive number e, there is a Sierpinski Curve X in S such that 


1) ` X lies in a tame 2-sphere 
2) each component of S—X is of diameter less than e 
3) A lies in X; in fact, A lies in the set of inaccessible points of X. 


This argument will establish the same result for subsets of 2-spheres 
other than tame arcs; in fact, the argument is valid for any closed set C for 
which it is known that a 2-sphere which is locally polyhedral, mod C, is tame. 


Question. Can C be any set which lies in a tame 2-sphere and which 
does not have a degenerate component? 


COROLLARY 4.1. If A is a tame arc lying in a 2-sphere S in E?, then 
there is a tame simple closed curve J such that A CJ CS. 


Proof. By Theorem 4, there is a Sierpinski Curve X which lies in a 
tame 2-sphere, which lies in S, and which contains A in its inaccessible points. 
Let @ be the upper semicontinuous decomposition of S whose nondegenerate 
elements are the disks of S—X. Since A lies in the inaccessible points of X, 
A does not intersect any of the countable collection of nondegenerate elements 
of G. Furthermore, by Moore’s theorem [15], the decomposition space is a 
2-sphere. It is easy to find a simple closed curve J in the decomposition space 
which contains the image of A in the decomposition space, and such that J 
does not intersect any nondegenerate element in the decomposition space. 
The preimage of J will contain A, will lie in 8, and will be tame, since it 
lies entirely in X, which in turn lies in a tame 2-sphere in E®. 


III. Piercing surfaces with tame arcs. An arc is said to pierce a 
2-sphere 8 in E® if the arc intersects S at only one point, and the ends of the 
are lie in different components of E®—-S. Other definitions of piercing are 
sometimes used. If D is a disk in Æ’ and apb is an arc that intersects D only 
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at the point p of Int D, then apb pierces D at p if and only if no small 
neighborhood of p contains an arc from ap to bp that misses p. Another 
alternative definition would be that apb pierces D if apb lies in a simple closed 
curve J such that each neighborhood of p contains another simple closed curve 
linking J. These three definitions are all equivalent, and will be used inter- 
changeably. For a complete discussion of linking, see [8]. 

In [7] Bing used Theorem 3 to show that every 2-sphere O in E° can 
be pierced by a tame arc. In fact, the argument showed even more, namely, 
if A is an arc lying in a tame Sierpinski Curve X C g such that A lies in 
the inaccessible points of X, then there is a disjoint family of tame arcs 
piercing S at each point of A. Using this fact and Theorem 4, therefore, 
we are able to conclude the following. 


THEOREM 5. If A is a tame arc lying in a 2-sphere S in E®, then S can 
be pierced by a tame arc at every point of A. In fact, there is a disjoint 
family of tame arcs which pierce S simultaneously at each point of A. 


This theorem answers in the affirmative Question 1 of the Introduction. 

Theorem 5 may be generalized to disks in a manner similar to that used 
in [7]. We define a cellular set in E? to b a set which is the common inter- 
section of a decreasing sequence of 3-cells. If C is a cellular set lying in 
the interior of a disk D in E®, then the argument of Theorem 2.1 of [7] 
establishes the existence of a subdisk D’ of D such that 


1) C is contained in the interior of D’ 
2) D lies in a 2-sphere in E°. 


Since any tame arc is a cellular set, the problem of dealing with a tame are 
lying in the interior of a disk in Æ’ reduces to that of a tame arc lying in a 
2-sphere. This establishes the following. 


COROLLARY 5.1. If A is a tame arc lying in any 2-manifold M in ES, 
then M can be merced by a tame arc at every point of A. In fact, there is a 
disjoint family of tame arcs which pierce M simultaneously at each point of A. 


A spanning arc of a disk is an arc whose end points belong to the 
boundary of the disk and whose non-end points belong to the interior of 
the disk. 


Lemma 6.1. If A is an arc in a 2-sphere S in E*, p is a point of A 
such that A ts locally tame, mod p, and S can be pierced by a tame arc at p, 
then A. is tame. 
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Proof. By Theorem 9 of [4], we assume that A is locally polyhedral, 
mod p. By Theorem 7 of [3], we further assume that 9 is locally polyhedral, 
mod’A. Thus, the only points of S that may not be locally tame points of 9 
are points of A. Let g be any point of A—p; let D be a small disk of 8, 
containing q on its interior, such that p does not lie in D, and such that 
D-A is a spanning arc of D. By Theorem 1 of [12], D is tame. Hence 9 
is locally tame at q. 

The only point, therefore, where $ is not known to be locally tame is p. 
But S can be pierced at p by a tame arc, so Theorem 1 of [14] implies that 8 
is tame. Since A lies in a tame 2-sphere, it follows that A itself is a tame arc. 


Lemma 6.2. If A, and A, are tame arcs intersecting in a common end 
point b, and if A,+ 4, lies in a 2-sphere 8 in E*, then A, + A, ts tame. 


Proof. By Theorem 5, it follows that $ can be pierced by a tame are 
at b. Thus, the arc A,-+ A, satisfies the hypothesis of Lemma 6.1, so 
A, +A, is tame. 

That all of the hypotheses of Lemma 6.1 and Lemma 1.2 are actually 
necessary may be seen from examples of wild arcs given in [11]. 

We now are able to characterize the piercing points of a 2-sphere. 


THEOREM 6. The 2-sphere S can be pierced at a point p by a tame 
arc B if and only if there is a tame arc A lying in 8 and containing p. 


Proof. One direction follows immediately from Theorem 6. The other 
direction is handled thus: 


Given the point p and tame arc B piercing S at p, we may construct a 
sequence {A,} of tame arc in 8 such that 44: Ain 7 Ø for all i, and lim Ay= p. 
This sequence is built by repeated use of Theorem 3. A ogien of subarcs 

’, C Ay is now selected so that A’: A’ = Ø if |i— j| =2, and A'r A'm is 
a common endpoint of both arcs. The arc A = p + > A’; is locally tame at 
points of the form A’, A'm by Lemma 6.2. Thus, A is tame, by Lemma 6.1. 

We note that although the arc A was constructed to contain the point p 

only as an end point, this is really no restriction in view of Corollary 4.1. 


CoroLLARY 6.1. If A is an arc in a 2-manifold M in EP, p is a. point 
of A such that A ts locally tame, mod p, and M can be pierced by a tame arc 
at p, then A ts tame. 


COROLLARY 6.2. If A, and A, are tame arcs intersecting in a common 
end point b, and if A, + As lies in a 2-manifold in E’, then A, + A, is tame. 
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COROLLARY 6.3. A 2-mdnifold M can be pierced at a point p by a tame 
arc B if and only if there is a tame arc A lying in M and containing p. 


These corollaries are established exactly as was Corollary 5.1, that is, by 
placing a section of the 2-manifold M on a 2-sphere. 


IV. A simple closed curve which pierces many disks. The primary 
goal of the next three sections is to complete the characterization of tame arcs, 
one direction of which has already been established in Theorem 2. The 
problem may be stated thusly: If X is a closed subset of a 2-sphere S in E’, 
with X and S possessing the following property, which we indicate by (*, X, 8) 
for convenience, then what can be said about the set X? 

Property (*,X,S). I£ U is a component of H®—S, and e is a positive 
number, then there is a polyhedral 2-sphere 5”, a finite collection Di, De,---, Dx 
of mutually exclusive e disks lying in S’, a finite collection i, En © +, Em 
of mutually exclusive e disks lying in S, such that 


1. H(8, 9) <e. 
k 

2 HF -EDCT. 
4-1 


3. YCR 
1 
4, X-S EQ. 
4-1 


In particular, if X= A is an arc, it is true that (*,A, 8) implies that A is 
tame? The natural approach to the problem requires the following. 


Conjecture. (*,X,S) is a local property of the set X and 2-sphere S. 
That is, if 9, is another 2-sphere in Æ? such that there exists a disk D with 
X£CIntDCDCS-8,, and if (*,X,8) is satisfied, then (*,X,Si) is 
satisfied. 

Being unable to establish this conjecture, we are forced to prove that 


(*,4,9) implies that the arc A is tame via a considerably more devious 
method. 


THEOREM 7. If A ts an arc lying in a 2-sphere S in E? and satisfying 
(*, 4,5), then there extsts a simple closed curve J in S with ACJ such 
that (*,J,8) is satisfied. 


Proof. Let J, be any simple closed curve containing A and lying in 9. 
Using (*,4, S), one may approximate S from U=Int$ within e, so that 
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A: È E =Ø. A homeomorphism ha is now defined on Ja, fixed on A, and 
taking J,—A entirely into 8 == SB The approximation process is now 


repeated, this time from Ext 8 within €, and a homeomorphism hs is defined 
on Ja = hı (Jı), with h: fixed on A, and moving J,— A off of the second set 
of e subdisks of 8. If this procedure is repeated again and again, alternating 
the approximations to be first from Int S and then from Ext S, and if the « 
are selected sufficiently small, then J = lim J; will satisfy the conclusion of 
Theorem 10. 

The e must be chosen, Ays so that 


{0+ hahaha}: Tod 


is actually a homeomorphism, by means of Theorem 7 of [7]. Secondly, we 
require that ez is less than one fourth the distance from Jz to the set of e 
disks; we require that es is less than one fourth the distance from J, to 
the set of «, disks, as well as es < «2/2. In general, we require that « is 
less than one fourth the distance from J; to the set of e disks, as well as 
«a < min (64/2, 42/4, ° *+,6,/2**), This insures that J is disjoint from all 
« disks, i= 1,2,- - +, and completes the proof. 


COROLLARY 7.1. If pis a point lying in a 2-sphere 9 in E? and satisfying 
(*,p,8), then there exists a simple closed curve J in S with p contained 
in J such that (*,J,8) ts satisfied. 


The proof is identical to that of Theorem 7. 


Lemma 8.1. If J is a simple closed curve lying in a 2-sphere S in E8, 
and p is a point of J at which S can be pierced by a tame arc, then there is 
a tame arc A in S which “crosses” J at p; that is, A: J =p, and A—p has 
two components which lie in different complementary domains of S—QJ. 


Proof. By the technique used to prove Theorem 6, in each comple- 
mentary domain of S—J, a tame arc may be built having p as an end point. 
The union of these two tame arcs is tame, by Lemma 6. 2. 


THrorem 8. If J is a simple closed curve lying in a 2-sphere in E® and 
satisfying (*,J,8), then there is a disk E such that J pierces E. 


Proof. The proof is broken into six steps. 


1) If U—IntS and e>0, then (*,J,S8) assures the existence of a 
polyhedral 2-sphere §’ satisfying four conditions. We observe that for e 
sufficiently small, the third condition may be replaced by a stronger one: 


3’-S— SE, C Ext 8’. 
41 
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The argument showing this fact is given in the proof of Condition 3 of 
Theorem 2, as well as in the proof of Theorem 4 of [6], and will not be 
repeated here. As a consequence of Condition 3’ and Condition 4, we have 
that J C Ext §’. The analogous result holds for U == Ext S, of course. 


2) Given «> 0, there is a 2-sphere Q satisfying the four conditions of 
(*,J, S) for U=Int$ and e, and another 2-sphere R satisfying the four 
conditions of (*,J,8) for U =— Ext8 and « We now show that we may 
assume that Q: R= Ø. : 

We may suppose that the diameter of J is greater than «. There exists 
a positive number 8, such that any 8, subset of S lies in an e disk of S. There 
exists a positive number §, such that any 8, subset of a 2-sphere lying homeo- 
morphically within 8, of 8 lies in a 8,/4 disk of that 2-sphere. 

There exists a polyhedral 2-sphere Q’, a collection of 8, disks D'i, D’3,---, 
D'y in Q’, such that 


1. H(S,Q’) < 8z 
& 

2. Q —ED,C Its. 
ia 


Letting 8; be the minimum of 8 and dist(Q’— $ D, S), there exists a 
polyhedral 2-sphere R satisfying the four conditions of (*, J, S) for U == Ext 8 
and ô. Thus, R: [Q — $ D:] =Ø. The 2-sphere Q’ is now adjusted 
slightly on the subdisks D’; to form a new 2-sphere Q which will be entirely 
disjoint from R, and which still satisfies the conditions of (*,J, 8) for 
U = Int S and e This adjustment is performed as follows. 

Without loss of generality, we suppose that Q’ and R are in general 
position. Let K be an “innermost” simple closed curve in R of all the 


è 
simple closed curves of [> D’;]-R, i.e., K bounds a small subdisk Z of R 
de 


with [Int Z]-Q’=. Since K lies on some D’; it follows that diam(K) < 8z, 
so diam(Z) <8,/4. We replace the subdisk bounded by K in D; by the 
subdisk Z of R, then push this adjusted subdisk slightly to one side of R, 


k 
thus eliminating at least one simple closed curve of [ $ D’,]:R. This process 
il 


is continued until all intersection is eliminated. The new 2-sphere obtained 
in this manner is called Q and the newly obtained subdisks of Q derived from 
the disks >) D’; are called $D, Obviously, Q-R—@. All that remains to 
be seen is that Q satisfies Conditions 1-4 of (*,J,8) for U=Int$ and «. 
It is easy to verify that Q is homeomorphically within 8,/2 of Q’. Thus, 
Q is homeomorphically within §,/2 +8, of S, so H(S,Q) <«. 
Each disk D; has diameter less than diam(D’;) + 8,/2, which is less 
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k 
than 8,. The relationship Q’— > D’, C Int S immediately shows, moreover, 
k 1 
that 9 — > Dı C Int 8. 
ia 


The e disks of S satisfying Conditions 8 and 4 still need to be constructed. 
Since each component of Q-S lies on some Dj, it has diameter less than ô, 
and, therefore, lies in an e disk of S. We take the upper semicontinuous 
decomposition @ of S whose nondegenerate elements are components of Q'S, 
then consider the big 2-sphere of the resulting cactoid. The arc A, when 
viewed in the decomposition space, misses the image of these nondegenerate 
elements, and must lie in the big 2-sphere, since diam(A) >e Thus when 
small disks are selected covering the image of these nondegenerate elements, 
these disks may be selected to miss A. The preimage of these disks in S are 
the desired disks E., Ea, © +, Em. For more details, see Theorem 9 of [8]. 

3) We now build a first approximation of the disk E. Let p be any 
point of J at which S can be pierced by a tame arc; it is known that there 
are many such points [7]. By Lemma 8.1, there is a tame arc A crossing 
J at the point p. Now Theorem 4 may be used to find a Sierpinski Curve X 
such that X lies in a tame 2-sphere and A lies in the inaccessible points of X. 
By moving this tame 2-sphere with a space homeomorphism, we may assume 
that X lies in the xy-plane in E®, that A is the straight line interval 
{(z,y,2)/a=0, Lage tl, z= 0}, and that P= (0,0, 0). 

The set X is obtained from S by removing the interiors of a sequence 
of disjoint disks Bı, Ba, © °. We select a disk Æ, in the yz-place such that 
Int E, contains (0,0,0), A is a spanning arc of E., [Bd #,]-[ SB] = Ø, 
and Bd F, links J; this is shown schematically in the figure. 

The disk E, is a first approximation to the desired disk E. Of course, 
E, may not yet satisfy the conclusion of Theorem 8, because J may intersect 
E, many times on feelers like Bs and B, in the figure. By means of (*,J,8), 
we will adjust F, to eliminate such intersection, thus completing the proof. 
In the figure, it is clear that F, can be deformed around B, and B,; however, 
if B, and B, had “horns” which hooked together as in [1], and if J ran 
through these horns, then the situation would be very bad. Intuitively 
speaking, this is exactly what (*,J,8) prevents from happening. 

4) Let i, be the smallest integer such that B,-J-H, A. In this step, 
we alter E, to remove such intersection. We define 


a = dist (H,-B,, [8 —B,]-#,+ Bd E) 
6 — {z | z lies in F, and dist(z, #,- Ba) < 4/3} 
66 = {z | z lies in F, and dist(z, #,- Bu) = 2/8}. 
The alteration of E, will occur only in the set ©. 
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There exists a polyhedral 2-sphere Q and a polyhedral 2-sphere R satis- 
fying the conditions of (*,J, 8) for U = Int 8 and for U = Ext 8, respectively, 
and for the positive number «. The size of e will be decided on later. By 
Step 1, we may assume J C Ext Q and J C Int R. By Step 2, we may assume 
Q:R=§. Call q the homeomorphism taking S onto Q and moving points 
no more than ¢,; call r the analogous homeomorphism taking 8 onto R. 


2 





Since 96:89 Ø, by choosing «e sufficiently small, we insure that all 
points of 80 lie either in IntQ-Int FR or in ExtQ-ExtR. This follows from 
Theorem VI13 of [13]. Assuming that Q, R, and F, are in general position, 

' we label the simple closed curves of [Q +R]: O as Kı, Ka: © °, Ki. By 
choosing ce, sufficiently small, we may require that 


t 
ZK: — q (B;) : E, +r (Ba) Br. 


Select an “innermost” K; in q(Ba) which we will relabel as K, for 
convenience. Replace the disk that it bounds in Æ, with the disk that it 


10 
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bounds in g(B,,), then deform this new disk slightly to one side of q(B,), 
thus eliminating the intersection. This process is continued, relabeling a 
second, now “innermost” simple closed curve as K,, replacing a disk, and 
deforming to one side, as before. When all the simple closed curves K, which 
lie in g(B,) have been removed, the same process is carried out on r(B,). 
We call the disk constructed from £, in this manner Fz. 

Since Q and R are both disjoint from J, we can guarantee that 
J-H,CJ-H,. Furthermore, the accomplishment of this adjustment is the 
following. 

Ba: J- E, = Ø. 


To see this, suppose that y is a point of By,:J-H,. Since J C Ext Q: Int R, 

any ray from y to © in general position will intersect Q + R an odd number 

of times. We now construct a ray contradicting this fact. The point y lies 

in Ö, yet does not lie in the interior of any simple closed curve Kj, or it 

would have been eliminated in the formation of E, from E,. It follows that . 
an arc may be drawn in F, from y to a point of 06, so that this arc is dis- 

joint from Q + R. Since each point of 90 lies either in Ezt Q: Ext È or in 

IntQ Int R, we have the desired contradiction. 

We note that (0,0,0) is not moved in forming E, from E,, because all 
alteration took place in the set @; 6 does not intersect the arc A, while A 
spans F, and contains the point (0, 0,0). 

5) We select i, to be the smallest integer such that Bẹ’ J: E 49, then 
approximate $ within e» and adjust Æ, to remove this intersection, exactly as 
in the previous step, forming Fs. The process is continued and the set 
E = lim E; will now be shown to satisfy the conclusion of Theorem 8. 


i> 
6) By observing that lim B,, = (0,0,0), and requiring that lim « = 0, 
j>% i> o 
we insure that # is actually a disk. Furthermore, J intersects H only at 
(0,0,0), and J links BUE=BdE,; thus J pierces F. 


COROLLARY 8.1. If J is a simple closed curve lying in a 2-sphere S in 
E? and satisfying (*,J,8), then there is a dense subset of J at each point of 
which J pierces a disk. 


Proof. In the proof of Theorem 8, the point p where J pierced the disk 
E was selected with only one restriction: It was a point of J at which 9 could 
be pierced by a tame are (Step 3). Since such points form a dense subset 
of J [7], the result follows. 


V. Surrounding J with thin tori. A torus is any set homeomorphic 
to the cartesian product of two simple closed curves. A solid torus is any 
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set homeomorphic to the cartesian product of a 2-cell and a simple closed 
curve. If T is a torus in E®, it is not always true that T+ IntT is a solid 
torus, for T -+ IntT may be a cube with a knotted hole instead. In the 
statement of Theorem 9, the concept of solid torus will not be used at all; 
instead, the weaker concept of a 2-dimensional torus plus its interior will be 
used exclusively, for convenience in the proof. The theorem is also true 
when stated using solid tori in place of tori plus their interiors; this follows 
trivially once Theorem 10 is established. 


THEOREM 9. If J is a simple closed curve lying in a 2-sphere 8 and 
satisfying (*,J, 9), then J ts the intersection of a decreasing sequence of tort 
plus thetr interiors. 


Proof. It suffices to show that, given «> 0, there exists a torus T in E? 
such that J C Int T, and T lies in an e neighborhood of J (the set of all 
points in #° whose distance from J is less than e). Roughly, the idea of the 
proof is this: Select a small annulus on § which contains J. Use (*,J,8) 
to deform this annulus into Ext 8 and into Int. Lastly, join the edges of 
these two deformed annuli with two more annuli, thus forming a torus. We 
now give details. 

We may select simple closed curves J, and J; in § such that J, and J, 
are in opposite complementary domains of SJ, J, and J, are tame, and 
the annulus V which lies in § and has J, + J; as its boundary will lie in an e 
neighborhood of 8. This is easily done via Theorem 3. Without loss of 
generality we assume that J, and J, are polygonal. 

A simple closed curve K may be found in #*—-V which links J, and J, 
i.e which links the annulus V. Let R be a ray starting at any point j of J, 
such that R:S==j7. We assume that R is locally polyhedral mod j. J, and J} 
are now blown up a bit into thin disjoint tori T, and T, such that 


(a) J; circles Int T, once longitudinally, i == 1,2. 

(b) JC Ext T, i=1,2. 

(c) T,+7,-+V has diameter less than e. 

(d) K-[7,+Intl,] = Ø, i=1,2. 

(e) [T,+ Int T;] intersects only one complementary domain of S —J, 

t= 1,2. 
(£) Ti R=, i=1,2. 
Inside the torus T, even a thinner torus 7’; is selected so that J’; circles 


Int 7”; once longitudinally, and thin enough so that if D is a disk of V with 
BaD C Ti+ IntT, then DC T,+ Int Ty. 
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The annulus V will now be deformed a small amount to either side of 8. 
By (*,J, 8) there exist homeomorphisms gq and r of 8 into E* such that 


(1) JC Extg(8) and J C Intr(8). 
(2) g(8) and r(S) are disjoint. 


That there are such homeomorphisms follows exactly from the proofs of 
Steps 1 and 2 of Theorem 8. We place six more restrictions on q(3) and 
r(S), all of which may be obtained simply by requiring that points are moved 
a sufficiently small amount by g and r. 


(3) g(J4) and r(J4) both circle Int 7”; once longitudinally, i — 1,2. 

(4) T,+T.+4(V) +7(V) lies in an e neighborhood of J. 

(5) If D is a disk of g(V) or r(V), and BAD C T’, then D C T, 
i=1,2. 

(6) K links the annuli g(7) and r(V). 

(7) [Z+ Int T] intersects only one complementary domain of ¢(8) 
—q (J), t—=1,2. The same requirement is made for r. 

(8) Let B be a small annulus contained in V — T, — T, which contains 
J. We require that q and r move points less than dist(B, Ta + T:) 
and dist(R,S—B). 


Without loss of generality, we assume that q(V), r(V), T^, T'a, and R 
are in general position. Thus, g(V)-[7’1-+ 7's] is a finite collection of 
simple closed curves. If L is one of these simple closed curves, then L is either 
longitudinal on the annulus g(V) or bounds a disk on g(V). Also, L cannot 
be meridianal on 7”, since it would link q(J4) ; thus L is either longitudinal 
on T”, or bounds a disk on 7’, by Theorem 1 of [9]. We now show that L is 
longitudinal on g(V) if and only if it is longitudinal on Ti. 

If L is longitudinal on T“, then it cannot be shrunk to a point in #°— K. 
Also, if L is longitudinal on qg(V), it cannot be shrunk to a point in E°—K. 
But if L bounds a disk on either g(V) or on 7”, then it can be shrunk to a 
point in #°—K. The desired correspondence follows. 

We now remove all longitudinal simple closed curves of q (V): [T^ + T’2] 
from q(V), dividing g(V) into components. Call C’ the component of q(V) 
containing g(J); © will have two boundary simple closed curves which, 
because of Restriction (7) above, cannot both lie on the same torus T”, We 
select C” analogously in r(V). Restriction (8) implies that 


R-a(S) CR-g(B) CR C 
and 


R-r(8) CR-r(B) CR-0” 
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Since R intersects g($) +r($) an odd number of times, R must inter- 
sect O” + 0” an odd number of times. Selecting an annulus U, on 7”, joining 
to O”, an annulus U, on T’, joining C’ to O”, the set C -+ 0” +U,+U; 
forms a singular torus intersecting R an odd number of times. We now 
change this into a real torus. 
An “innermost ” simple closed curve M of the singular set of C’ -+ 0” 
+ U -+ U, is selected on U,. M bounds a disk in either C’ or C”; this disk 
is replaced by the disk bounded by X in Uj, then moved slightly to the side, 
thus reducing the singularity. This process is continued until a real torus T 
is formed. By Restriction (4) above, T will lie in an e neighborhood of J. 
The ray R will intersect T an odd number of times; for, each replacement in 
yielding T from the singular torus is made by interchanging two disks, both 
of which lie in T; + Int T, 11,2, by Restriction (5). Thus, Æ does not 
intersect either of these two disks, and R-T has an odd number of points. 
This implies that J C Int T. 


VI. Completing the tame arc characterization. We may now prove 
the main result of this paper. 


TAEoREM 10. An arc A lying in c 2-sphere S in E? is tame if and only 
tf (*,4,8) is satisfied. 


Proof. One direction has already been proved (Theorem 2). We now 
establish the other direction. 


By Theorem 7, A is contained in a simple closed curve J such that 
(*,J,8) is satisfied. Corollary 8.1 and Theorem 9 tells us that J satisfies 
the hypothesis of Theorem 2 of [12]. Thus J is tame. a 


Teeorem 11. If S is a 2-sphere and Y is the set of points of S at 
which 8 cannot be pierced by a tame arc, then Y is a-0-dimenstonal Fo set 
(and, therefore, of the 1st category). 


Proof. That F is 0-dimensional follows from [7]. We define Y;.to be 
the set of all points p in $ such that (*, p, 9) cannot be satisfied for U = Int 8 
and e==1/i. Similarly, Z; is defined to be the set of all points p in S such 
that (*, p, S) cannot be satisfied for U == Ext 9 ande—1/t. For each positive ` 
integer t, Y; and Z are closed sets. Furthermore, each F; and Z; is nowhere 
dense in S, since every tame are of S lies in S—Y¥,—Z,, by Theorem 2. 
‘This shows that > F, +> Z is a 0-dimensional Fo set, and, therefore, of the 
ist category in 8. 

We complete the proof by showing that Y= Y+ SZ, If p lies in 
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S—Y, then p lies in a tame arc A in S, by Theorem 6. But A does not 
intersect any F, or Z, by Theorem 2. Thus, p lies in S—(Y¥i+ È 2). 
Conversely, if p lies in S—(S¥i+ 24%), then (*,p,$) is satisfied. By 
Corollary 7.1 and Theorem 10, p lies in a tame arc A in S. By Theorem 6, 
p does not lie in Y. 
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THE STRUCTURE OF DISTAL FLOWS.* 


By H. FURSTENBERG. 


Introduction. We shall be dealing exclusively with flows on a compact 
metric space. By a flow on X one usually understands a (continuous) repre- 
sentation of the additive group of reals as a group of continuous transforma- 
tions {r —œ < t <% } of the space X. Before stating the problem we shall 
study, it will be best to summarize what is known for a rather special kind of 
flow. We say that a flow is equicontinuous if the transformations 7; form an 
equicontinuous family. In the case of equicontinuous flows, two assertions can 
be made, and these completely determine the structure of such flows. First, 
if there is on X an equicontinuous flow, then X decomposes into a disjoint 
union of subsets, each of which is invariant under the r,, and on each of 
which the flow is minimal. We say a flow is minimal on a space if no closed 
proper subset of the space is carried into itself by all the transformations of 
the flow. The analysis of equicontinuous flows is thereby reduced to that of 
minimal equicontinuous flows. The second assertion concerns the latter. 
Namely, if there is a minimal equicontinuous flow on X, then X must be 
homeomorphic to a compact abelian group, and the transformations of the flow 
correspond to multiplication in the group by elements of a one-parameter sub- 
group. Conversely, starting with a compact abelian group and a one-parameter 
subgroup, there is determined a flow on the group which is equicontinuous. 
The theory of equicontinuous flows is thereby reduced to the theory of compact 
abelian groups. 

It should perhaps be pointed out that these facts have a bearing on the 
theory of almost periodic functions (in the sense of Bohr) on the real line. 
If f(t) is an almost periodic function, then the uniform closure of the trans- 
lates of f is a compact space X, and the operations of translation in X deter- 
mine a flow which is clearly equicontinuous in the uniform metric on X. This 
flow can be seen to be minimal and so X is a compact abelian group. The 
real line is imbedded as a dense subgroup of X and one may show that f(t) 
extends to a continuous function on X. The theory of compact abelian groups 
then implies, among other things, that f is a uniform limit of linear com- 
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binations of characters on X; hence f(t) is a uniform limit of linear com- 
binations of exponentials on (—œ, œ). 

We turn now to the (informal) definition of a distal flow. Let d(z,y) . 
denote the metric on the space X, and let {7:} be a 1-parameter group of 
transformations of X. We say the corresponding flow is distal if for any pair 
of distinct points x,y € X, the distances d(r,2,r,y) are bounded away from 0 
for —o <t<w. It is not hard to see that this definition is independent 
of the metric used. Now if a flow is equicontinuous, we can always introduce 
an equivalent metric d’(z,y), for which d’(r:2,7:y) is independent of t; 
so an equicontinuous flow is always distal. For some time it was believed 
that the converse might be true, but now there are a number of examiples 
showing that this is not the case. We will presently examine some of these 
examples. 

Once it is recognized that the class of distal flows is larger than that of 
equicontinuous ones, we may ask whether the results mentioned above have an 
analogue for distal flows. The first mentioned property (which is by no means 
trivially true) is in fact known to be valid and a general distal flow decom- 
poses into minimal ones. This a consequence of the work of Ellis ([4]). 
The problem we shall study is to find an analogue of the second assertion; 
„that is, to exhibit, in a sense, the most general minimal distal flow. l 

One class of examples of distal flows that are not equicontinuous is given 
by the “nilflows” or flows on nilmanifolds ([1,2]). Let N be a nilpotent 
Lie group and T a discrete subgroup such that N/T is compact. The group 
N acts in a natural way on the homogeneous space N/T, and if {g(t)} is a 
one-parameter subgroup of N, there is determined a flow on N/T. This flow 
is known to be distal, and in general it will not be equicontinuous. 

Another class of examples, but of discrete distal flows (with the group 
of integers replacing the reals) is given in [6]. A particular example is the 
flow on the 2-torus (£7), | €| = |n | = 1 generated by 


(1) (én) — (e6 9(€)n) | 
‘where y is a continuous function with |y(£)|—1. Let us show that this 
is distal. 

The map (£,n) > é gives a fibering of the torus over the circle into a 
bundle of circles. The transformation + permutes the fibres among them- 
selves. Moreover, each fibre (i.e. for fixed £) is transformed isometrically, 
so that pairs of points on the same fibre remain the same distance apart under 
the flow. Different fibres also remain the same distance apart under the flow, 
so two points on distinct fibres can never get closer than the distance between 
these fibres. This make it clear that the flow is distal. 
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On the other hand, the flow generated by (1) is generally not equi- 
continuous. For example, take y(£)=£. Then 
(2) (En) = (ett, ondal gng), 

In particular the second component of "(er*/r&,n) is the negative of that of 
7(& 7). Hence these two points are bounded away from one another although 
(eting, nm) —> (én). Hence the family {r*} is not equicontinuous. 

This second class of examples can be enlarged considerably. Suppose 
we are already given a distal flow in a space X. Let Y be an m-sphere bundle 
over X with the orthogonal group in m+ 1 variables as the structure group. 
Let a flow on Y be given by having r; take the sphere above y€ Y into the 
sphere above rey, the transformations of the individual spheres being rotations. 
More generally, instead of m-spheres, we may take homogeneous spaces of 
arbitrary compact groups. The reasoning used before shows that such a flow 
on Y will again be distal. Now the same procedure may be repeated finitely, 
or even infinitely, often, and starting with an equicontinuous flow, we may 
build up a large family of distal flows in this manner. 

Indeed, the flows on nilmanifolds also avise in this way. For example, 
let N be a 2-step nilpotent Lie group, i.e., N/N, is commutative, where N, 
is the centralizer of N. Let T be a discrete subgroup of N with N/T compact. 
Then N/N,'T is a torus and there is a natural map N/T > N/N a T. N/T 
is then a fibre bundle over a torus and the fibres are ~ N, T/T Z N/N LOT 
and since N, is commutative, the latter is a compact abelian group. It is not 
hard to verify that the flow on N/T arises from a equicontinuous flow on the 
torus V/N,-T in the manner described above. l 

Our main result, Theorem 2.4, is suggested by these observations. 
Namely, we shall show that by approximately this procedure, one may build 
up the most general minimal distal flow. This result will be stated precisely 
in §2. 

At this point, the author wishes to acknowledge his indebtedness to 
Frank Hahn who pointed out certain similarities between the distal flows 
and. equicontinuous flows and who posed the problem of analyzing the struc- 
ture of the former. 


1. Preliminaries. We shall consider flows for groups more general than 
the real line or the integers. The arguments are virtually the same for an 
arbitrary locally compact group as for the reals and we have one application 
for the general result (§ 12) which is uninteresting in the case of 1-parameter 
flows. The locally compact parameter group will be denoted by T and will 
be fixed throughout the discussion. f 
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Definition 1. A flow (X,T) on the compact metric space X is given by. 
a continuous map of TX X— ZX, denoted (1,2) —rz, satisfying rı(r2) 
== (tıra) z, where 71,72 € T, zE X, and ex == where e is the identity element 
of T. 


Definition 1.2. Let (X,T) and (¥,7) be two flows and let r be a map 
of X onto Y. We say that (Y,T) is a subflow of (X,T) ((X,T) is an 
extension of (7,T)) relative to m, if for every r € T, ze X, a (rn) =r(r(2)). 
We also write in this case (Y, T) =#(X,T). 

Let (Y,T) be a subflow of (X,T) relative to m. If y€ Y, we shall 
sometimes denote the inverse image x*(y) by Xy. The condition that (Y,T) 
be a subflow of (X,T) may be expressed as X, C Xm, TET, ye Y. The 
subsets X, will be referred to as the fibres of X (with respect to Y, or over Y). 


Definition 1.3. Two flows (X,T) and (Y,T7) are tsomorphic if (Y,T) 
is a subflow of (X,T) relative to m, and the map 7: X->Y is a homeo- 
morphism. If x is not a homeomorphism, we shall say that (Y, T). is a proper 
subflow of (X,7), or that (X,T) is e non-trivial extension of (Y,T). 


Definition 1.4. The flow (Xo, T) is trivial if X, consists of a single 
point, and the transformations of T are all identity transformations. 

The trivial flow is a subflow of every flow. 

Let (X, T) be a flow and m. (X, T) = (Y,T), ws(X,T) = (Y, T) two 
subflows. Suppose, that there is a map x’: Y,—>Y, such that m, == r om. 
We claim that if such a map ~’ exists, it is uniquely determined by this. 
condition. For m: XY, is onto, so that =’ is determined by the require- 
ment rs =r Om, Now in most of our discussion a flow (X,7') will be given 
such that all other flows that occur are subflows of this one. If we speak of 
a subflow (Y,7') of (X,T) it is to be understood that there is a fixed map. 
ay: X — Y relative to which (7,T) is a subflow of (X,T). If for two such. 
subflows, (Yı, T) and (Y, T) we speak of (Ya, T) as a subflow of (F, T), 
it will then be with respect to the unique map =’ of Y, onto F, satisfying 
my, =n ony, Ify,€ Ya, then y, = ry, (2), c€ X, and ry =e ry, (r£). Hence 


z (1Y1) =x’ O my, (12) = my, ( 12) = Tay, (2) = ra’ omy, (2) = rr (ys) 


and 7’ actually does determine (Y,,T) as a subflow of (¥i,7). As a result. 
there is determined a partial ordering among the subflows of (X,T): 


m(X,T)< m(X,T) if ma = T’ On, 


for some r. 
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Definition 1.5. The flow (X,T) is minimal if no closed proper subset 
of X is invariant under the action of T. 

Equivalently, (X, T) is minimal if Tr is dense in X for every ze X. If 
(X,T) is any flow, there will exist (by the compactness of X) at least one 
minimal closed subset X’ C X invariant under T. There is then a flow (X, T) 
on X’ and this is clearly minimal. We speak of (X’,T) as a minimal com- 
ponent of (X,T), and of X’ as a minimal set in X. The minimal sets of X 
do not always exhaust the space X. For example, let X be the one point 
compactification of the real line, X = RU {0}, let T = R with ri(s) == s + t, 
ri(œ%) = œ. Then {co} is the only minimal set in X. An important property 
of the distal flows that we shall study is that they are “semi-simple,” in the 
sense that X is the union of its minimal sets (which are, of course, non- 
overlapping). 


Definition 1.6. Let d(Tı, £2) denote a metric on X. The flow (X, T) 
is distal if whenever 21, z, are distinct points of X, d(r7,,r2,) is bounded away 
from 0 as r ranges over T. 

Equivalently, (X, T) is distal unless for a pair of distinct points 2,,x7,€ X 
there is a sequence 7, in T and a point 2€ X such that rat, —> 2, and ma — 2. 
From this it follows that the above definition is independent of the metric 
d(-,*). 


2. Isometric extensions. Let M be a homogeneous compact metric 
space. By this we mean a compact metric space such that for any two points 
x, y € Al, there is an isometry of M taking z into y. The isometries of M form 
a compact group H, and M may be identified with a coset space H/H,, where 
H, is the subgroup of H leaving a given point of M fixed. Conversely, if H 
is a compact group satisfying the first axiom of countability and Hy is a 
closed subgroup, then H/H, may be given a metric which is invariant under © 
H, so that M == H/H, is a homogeneous compact metric space. l 


Definition 2.1. Let X and Y be compact metric spaces, 7 a map of X 
onto Y, and M a homogeneous compact metric space. We say that X is an 
M-bundle over Y if there is a real valued function p(a,%2) defined for all 
pairs 21, 2, in the same fibre of X (i.e. whenever »(z,) == 7(#2)) and such that 

(a) p(%,%2) is continuous as a function on the subset of X X X defined 
by the condition r(z,) = ~r (T2). 

(b) For each y€ Y, p(a,22) defines a metric on the fibre X, under 
which X, is isometric to M. 

For example, let X be a fibre bundle over Y with fibre M and with 
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structure group, the group of isometries of M, and let m be the map of X > Y. 
If Ọ is a small enough open subset of Y, then r*>(U) =U X M, and we can 
define py (21,22) for r(z1) —7(#,) € U as the metric in M. Let {U,} be a 
covering of F by such neighborhoods. On «w*(Ui) Nw+(U;) the functions 
pu, (21,23) and py, (21,22) agree since the structure group acts by isometries. 
It is then evident that X is an M-bundle over Y. It is not clear whether the 
notion of an M-bundle is actually more general than that of a fibre bundle 
of the kind just described. , 


Definition 2.2. Let X be an M-bundle over Y with m: X >Y, let (X,T) 
be a flow and (¥,7) =#(X,T) a subflow. We say (X,T) is an isometric 
extension of (Y,T) if the function p(2,%2) of Def. 2.1 satisfies p(rXı, 722) 
==p(%,2,) for all r€ T, and 2, zz in the same fibre of X over Y.. 

Thus each fibre of X is transformed isometrically by the transformations 
of T. The following proposition was proved informally in the Introduction. 


Proposition 2.1. An isometric extension of a distal flow ts distal. 


Proof. Let rm: X— Y where (X,T) is an isometric extension of (Y,T). 
‘If (X,T) is not distal, then for some pair 2,42, and sequence {ra} in T, 
“tal, Z, Trl,—>2. Applying m to these limits, we have tat (T1) > a(z), 
tym (22) —>r(z). But since (¥,7) is distal, this can only happen if 
(z,)—=r(2). Then p(TnT1, TnT) is defined and equals p(x,,2,), But 
p (TnT, TaT) > p(2,2) ==0 by the continuity of p. This gives p(7,,2,) =0 
and since p defines a metric on each fibre of X, t, == z, This is a contra- 
diction and so (X,7') is distal. 


Definition 2.3. Let (X,T) be a flow and let 3 = { (Xa, T) } be a collec- 
tion of subflows of (X,T), (Xa, T) =ra(X,T). We say that (X,T) is a 
‘limit of the flows in % in case for every pair of distinct points T4, 7, € X there 
is a subflow (Xa, T) such that wa(z,) Ars(?r). 

For example let X denote the infinite dimensional torus: X = {(€,, ta °°"), 
|&|=1}, let X, denote the n-dimensional torus and let ra: X—>X, be 
defined by mm (fs, a’ - +) = (fy ba © tota). Lf T denotes the integers and 


(X,T) is generated by 
r (ĉi Ca‘ rn ® 5) 

= (6: (1); $2 (fote); 2 “s On (f° i ssa): . D 
then (X,T) is a limit of (Xq,T) (X, T). 


(2.1) 


PROPOSITION 2.2. A limit of distal flows is distal. 
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Proof. Let (X,T) be a limit of a collection 3 = { (Xa, T)} of subflows. 
We suppose that each (Xa, T) is distal. Suppose (X,7') were not distal. 
Then for a pair zı, x, of distinct points of X we would have rav;—> 2, Tavs, 2. 
Now for some (Xa, T), wa(%1) Æ Ta(%2). On the other hand rare(r,) > ralz), 
tata (Zz) > ra(2), which is impossible if (Xa, T) is distal. 


Definition 2.4. Let (X,T) be a flow and (Y,T) a subflow. Suppose 
there is an ordinal y such that to each ordinal é ņ there is associated a sub- 
flow (X& T) of (X,T) such that the following are satisfied: 


(a) (Zo T) = (Y,T) and (Xy,T) = (X,T) where 0 denotes the least 
ordinal. 
(b) TE<P,(XZ,T)< (Xe, T) (see the remarks preceding Def. 1.5). 
(e) For each £< n, (Xėn, T) is an isometric extension of (Xẹ T). 
(a) If € is a limit ordinal Sy, then (X,T) is a limit of {(Xe,T), 
& <§}. 
We then say that (X,T) is a quast-tsometric extension of (Y,T). 


Definition 2.5. A quasi-isometric extension of a trivial flow is called 
a quast-tsometric flow (q.i. flow). 


THEOREM 2.3. Every quast-tsometric flow is distal. 


Proof. If (X,T) is a q.i. flow, then for some ordinal 7, (X, T) = (Xn, T), 
where {(X,T),£E=n} is a well-ordered system of subflows of (X, 7’) satis- 
fying (b), (c), and (d) above with (Xo, T) the trivial flow. Let 8 denote 
the set of ordinals é << y for which (X¢, T) is distal. 0€ S and by Proposition 
2.1, if €€ 8 then €+1¢€8. Also if £ is a limit ordinal =» and ES for 
all & <é, then £€ 8 by Proposition 2.2. By transfinite induction we con- 
. clude that every <7 is in S and so (X,T) is distal. . 

' We may now give the statement of our main result. It will be proved 
in 8 10. 


THEOREM 2.4. Every minimal distal flow is quasi-isometric. 

Returning to Def. 2.5, we may say that a q.i. flow is one obtained from 
the trivial flow by a succession of isometric extensions. In our definition 
we have allowed for an infinite succession. As we shall prove in 813, this 
is necessary if we wish to account for all distal flows. As an example consider 
the flow on the infinite dimensional torus generated by 


Tı (Enta a Pole -) = (etti Ciba, abast * ty naba * ) 
where a is an irrational multiple of m. Defining the subflows (X,, T) as before, 
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we see that (X,,,,7) is an isometric extension of (X,,7'). Also the given 
flow (X,T) is a limit of { (Xa, T)}. The flow then corresponds to the ordinal 
w. We shall prove in 813 that no smaller ordinal will suffice. 


3. The Ellis group of a distal flow. The basic tool used in studying 
distal flows is the introduction of a certain compactification of the group T. 
We shall call this the Ellis group after Ellis who first introduced this com- 
pactification ([4]). For the reader’s convenience we shall reproduce that 
portion of [4] which is relevant to our disclussion. 

Let X be a compact metric space with metric d(-,-). By XZ is meant 
the space of all transformations of X — X, continuous or not. XZ is a compact 
Hausdorff topological space with respect to the topology defined as the weakest 
one rendering the functions @(f) = f(z), f€ XZ, ze X, continuous. A sub- 
basis for this topology is given by the sets of the form 


Ue(z,y) = {fE Xe: d(a,f(y)) <e} 


where z, y € X,e>0. Note that for a fixed fo € XZ, the map f— ffo is com- 
tinuous on X*, the inverse image under this map of U.(z,y) being U.(z, fo(y)). 
Also the map f— f (£o) is by definition continuous, for z€ X. On the other 
hand, the map f— fof is not in general continuous. However, if fẹ is a con- 
tinuous transformation of X, then one can show that f— fof is also continuous. 


Now suppose that (X,T) is a flow. We assume (primarily for con- 
venience of notation) that T is effective, so that T may be imbedded in XZ. 
We let @ be the closure of T in XZ; then @ is compact. 


THEOREM 3.1 (Ellis). If (X,T) is distal, then G is a group. 


Proof. Let us first show that @ is a semigroup. Let reT. The map- 
f— r" is continuous on X (since r* is a continuous transformation on X), 
so 7*@ is compact. Since TC rd, it follows that G C rG or rGC G. 
Now let ge@. Then sge@ for all 7E T, so Tg CG. Since f— fg is con- 
tinuous on XZ, it follows that Tg — Tg — Gg, so Gg C G, and we see that G 
is a semigroup. To prove the theorem we still have to show that every element 
of Œ has an inverse in G. Now it is quite easy to see that each ge G must 
be 1-1 on X, if (X,7') is distal. For, d(f(z),f(y)) is a continuous function 
on XZ, and if for some g € T, d(g(z), g(y)) =0, then the infimum of d(rz, ry), 
for r€ T, must be 0, and so z—y if (X,T) is distal. We will use this 
observation to prove that each g € G has a two-sided inverse in G. Let g¢ G 
and form T= Qg. T C G, and T is a compact semigroup. We shall show 
that T contains an idempotent, i.e., an f with ?—=f. Let A be a minimal 
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compact subset of T satisfying A-A CA. A exists by Zorms lemma. Now 
if f€ A, then Af is again compact and Af-Af C Af. So Af=4A. Therefore 
there exists u€ A with uff. The set of all these u form a compact set 
U CA, and U?CU. So again U—=A and fe U whence f—=f. We claim 
that f is the identity transformation of X. For f(f{z)) f(z) for sel. 
Since f € G, it is 1-1 and therefore f(z) =< for all z€ X and f is the identity. 
Moreover we may write f—g’g where g’€ G. We claim that g’ is a two-sided 
inverse of g. Since g'g is the identity, g'gg =g and g'gg (£) =g (x). By 
the univalence of g’, we have gg’(z) =s. Hence g'g = gg identity. This 
proves the theorem. ' 


Definition 3.1. The group @ will be called the Ellis group of the distal 
flow (X,T). The relative topology it has as a subset of X* will be termed 
the E-topology. 

One application of Theorem 3.1 is the proof of the “semi-simplicity” of 
distal flows. 


THEOREM 3.2. If (X,T) is distal then X is the disjoint union of the 
minimal sets in X of the flow. 


Proof. That the minimal sets of X are disjoint is clear. Now let G be 
the Ellis group of the flow. We claim that the minimal sets are exactly the 
orbits Ga for ve X. The sets Gr are invariant since T C G, so we need only 
show that no proper closed subset of Gr is invariant under the flow. Now 
since the map g— gy, y€ X, is continuous from G to X, it follows that 
Ty==Ty or Gy Ty. So if y belongs to an invariant closed subset of Gz, 
then Ty = Gy belongs to it as well. But if y€ Gz then Gy— Gz and this 
proves that Gr is minimal. Clearly the.sets Gr exhaust X. 


COROLLARY. If (X,T) is minimal distal, then the Ellis group G is 
transitive on X. 


The Ellis group is not a topological group in the usual sense. The product 
9192 is not even continuous as a function of the single variable gə, although 
it is a continuous function of g,. The operation g—> g% is therefore also not 
continuous, in general. It may be shown, in fact, that the Ellis group will 
be a topological group if and only if the flow (X, 7’) is equicontinuous. 

Also, when the distal flow (X,7) is not equicontinuous, the Ellis group 
should be thought of as being quite large, in some sense. For example, let T 
be the integers and X the 2-torus, and let the flow be generated by 


(3. 1) Tı (8, &) = (ef, y (ĉi) t2) 
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where a is an irrational multiple of =. Then the group @ cönsists of all 
transformations 


(3.2) g (Èo Le) = (eBZ,, 6 (61) 2) 


where £ is real and ¢ is any function of £, with | $(£,)| = 1, and subject only 
to the restriction that 


(ett) _ wate) 
3. 3 DZ 5 
oi, FO 
(3.3) would be a severe restriction, if & were required to be continuous. As 
it is, @ may be multiplied by any function on the circle group of unit modulus 
which is constant on cosets of the subgroup {e'**}. 
Let (X, T) be a distal flow and let (Y, T) =r(X,T) be a subflow. 


Lemma 3.1. Let G be the Ellis group of (X,T) and let ge G. If, for 
Ly, Z2 € X, mi, == nTa, then ngt = ngt. 








Proof. Since T is dense in G, the set {(rz,,r22),r€ T} is. dense in 
{(g’z, 92), 9’ € G}. Thus there exists a sequence {ra} in T with tatı > gti, 
TauTa —> gz Then 


ages — lim rat, = im ram, = lim tart, = lim ara 
=, TOL. 


As a consequence of this lemma we may map @ into YY : set G(r) == (gz) 
for ge@. This is unambiguous since mt =z, implies +(gz,) = r (gto). 
The map g— @ is continuous from G— YY inasmuch as {g: ğ(r(x))€ U} 
== {g: gv€ rU}, and this is open if U is open in X. Now T is imbedded in 
both XX and YY (possibly after identifying identical transformations) and 
G is the closure of T in X¥. We conclude that G is the closure of T in YY. 
Since G is again a group this implies that (Y, T) is distal. For d( gy, y2) 
attains its minimum in G, where d now denotes a metric in Y. If this. 
minimum were 0, then gy,— gy, and Yı =Y: So for YyıkYy., d(ryırYs) 
is bounded away from 0. We thus have another application of Theorem 3.1: 


THEorrm 3.3. A subflow of a distal flow is distal, and the Ellis group . 
of a subflow is the homomorphic image of the Ellis group of the flow. 


Given a flow (X, T) there is also defined a flow (X X X, T) by r(t, £3) 
= (121,125). The latter flow will not be minimal even if (X,T) is, since 
the diagonal is always a closed invariant subset. If G ie the Ellis group of 
(X,T) then @ is also the Ellis group of (XX X,T) where we define 
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g (21,42) = (921, 922). Similarly G is the Ellis group of. (X4, T) where X4 
is any power of X. 


4. Reduction of the problem. For the remainder of our discussion, 
(X,T) will denote a fixed distal flow. If (Y,T) is a quasi-isometric subflow 
of (X,T) then according to Definitions 2.4 and 2.5, there is a well ordered 
system (X¢, T) of subflows, for ordinals éS y, with (Xo, T) the trivial flow, 
(Xn 1) = (¥,T), and satisfying (b), (c) and (d) of Def. 2.4. Let us 
call such a system a quasi-isometric system. Every quasi-isometric system is 
supposed to have a last element. 

Let H denote the set of all quasi-isometric systems in (X,7). Thus each 
0€ H assigns to all the ordinals =< (8) a subflow (Xè T) such that the 
collection {(X¢g, T),é7(6)} forms a q.i. system. We impose the condition 
on the q.i. systems in H, that if é < &, then (Xg, T) is a non-trivial extension 
of (Xg T), that is, (X¢’, T) is not isomorphic to (X¢,7). With this hypo- 
thesis, the ordinals occurring in a q.i. system correspond to cardinals not 
exceeding the cardinality of X. We thereby avoid difficulties of the meaning- 
fulness of the set of all such system. We may define a partial ordering in H 
as follows. We say 6,9, if y(61) S7(62) and if the flows (Xz, T) coincide 
for 6, and 6, whenever é< 7(6,). The system 6, is then: to be a segment of 63. 


Lemma 4.1. A totally ordered subset of H has an upper bound in H. 


By a totally ordered subset we mean one such that if 6, and 6, belong to 
the subset, either 6, = 6, or 6, 43. 


Proof. Let % be a totally ordered subset. If 3 has a largest member, 
this will be an upper bound for X. We may therefore suppose that the set of 
ordinals {n(#),0€ X} has no largest member. Let y be the first ordinal larger 
than {n(6),0€ 3}. If E<y then &<n(9) for some 0 in 3, so (Xg T) is 
defined. Since X is totally ordered, the flow (X, T) is unambiguously defined. 
Let (X, T)=r:(X,T). Form the cartesian product [ite and let Xy be 


the subset of this product of elements of the form a, ), zeX. The map 
ay: X —> Xy defined by wy (£) — (zg(x)) determines a subflow (Xp, T). For 
E<, (X¢ T) is a subflow of (Xy,T) and (Xy,T) is a limit of {(X,T), 
&<n}. Now define a quasi-isometric system 6* by taking the (X¢,7') for 
&<n, together with (Xy, T) as here defined. To verify that this is a q.i. 
system, it is only necessary to show that y is a limit ordinal, since the condi- 
tions (b), (c), (d) are satisfied for é< y. Suppose, then, that n= n +1. 
We would then have 4o == n(0.) for some 0, € 3, for otherwise y, could have 
been chosen in the place of 7. But then 6, is clearly an upper bound, contrary 
to the assumption that 3 has no largest member. This proves the lemma. 
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PROPOSITION 4.1. The set H possesses a maximal element. 


Proof. Zorn’s lemma. 


Using Proposition 4. 1 we are able to bring about a considerable simplifica- 
tion in the problem of showing that every minimal distal flow is q.i. Namely 
we have 


THEOREM 4.2. Suppose (X, T) is a flow with the property that when- 
ever (Z, T) is a proper subflow, then we may interpolate between (Z, T) and 
(X, T) a flow (Y, T), which is a subflow of (X, T) and a non-trivial isometric 
extension of (Z,T). Then (X,T) ts quasi-isometric. 


Proof. If (X,T) is not quasi-isometric and 0 is a maximal element of H, 
then the last member (Z, 7’) of the system 0 is a proper subflow of (X,T). 
By hypothesis, there then exists an isometric extension (Y, T) of (Z, T) which 
is a subflow of (X,T), and (Y,T)54(Z,T). Now let 6* denote the q.i. 
system with (Xg,T) the same for 6* as for 6, if &<n»(9), and with 
(Zn, T) = (¥,T). Then 6* = 6 and 6* 46, which contradicts the maxi- 
mality of 6. This contradiction shows that the last member of 0 must be 
(X,T) and so (X,T) is quasi-isometric. 

The next six sections will be devoted to proving that if (X, T) is minimal 
distal, it fulfills the hypothesis of Theorem 4.2. We will thereby have proved 
Theorem 2.4 that every minimal distal flow is q.i. We conclude this section 
by giving an indication of the manner in which the proof will proceed. We 
suppose then that (Z,7’) is a proper subflow of (X,T). We may think 
of Z as being an identification space of X ; namely where the fibres of X over 
Z are identified as single points. If (Y,T) is to be interpolated between 
(X,T) and (Z,T), then Y is an identification space of X such that if two 
points of X are in the same fibre over Y they are necessarily in the same fibre 
over Z. ‘Thus each fibre over Z may be decomposed into fibres over Y. This 
set of fibres over Y in a single fibre over Z constitutes the fibre of Y over Z. 
The space F will be constructed by defining an equivalence relation in each 
fibre over Z and letting Y be the resulting identification space. If (Y,T) 
were given as an isometric extension of (Z, T), then there would exist a func- 
tion p(Yı,Y2) defined for yı, Yə in the same fibre over Z and satisfying the 
conditions of Definitions 2.1 and 2.2. The function p would induce a function 
R defined on pairs of points z,, z, in the same fibre of X over Z and satisfying 
related conditions. What we shall do is to construct the function R (z, 22) 
first and retrieve the space Y from it by identifying x, and zs if R(T, 72) =0. 
We notice that since p(ry.,ry:) —=p(¥:,42), we will also have R(72,, 722) 
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—R(2,2), where r€ T. Since R(z,,2,) is continuous, this will imply 
R(gz,, 9%2) = E (21, 22) for g in the Ellis group of (X,T). The crux of the 
problem lies in showing that a non-constant continuous function R(x, £a) 
exists which is invariant under G. Now fix a fibre X, of X over Z, and let 
Go be the subgroup of @ which takes X, into Xo. The restriction of R to 
pairs of points in X, defines a non-constant continuous function on X, X Xo 
invariant under @. It turns out that if we can find a function with these 
properties then we can also construct A (21,22) for all the fibres. As a result, 
for a good part of the discussion, we shall confine our attention to the single 
fibre Xo. 


5. The function F(x, x’) and the group Gp. 


Definition 5.1. For 2,2’ € X, define 
(5.1) F(a, 2’) = glb{d (rz, rz’), r € T} = inf {d(gz, gv’), g € G} 
where @ is the Ellis group of the distal flow (X, T). 

The second equality in (5.1) follows from the fact that d(gz, gz’) is a 
continuous function on G, and T is dense in G. The following assertions 
follow directly from this definition. 


Proposition 5.1. (a) Fi, )=F(r,z), (b) F(z, 2’) =0 and equality 
holds only if z =x, (c) F(gz, gz’) =F (2,2) for ge G, (d) F(z,2’) is an 
upper semi-continuous function on X X Z. 


Proof. (a), (b), and (c) are obvious under the hypothesis that (X, 7) 
is distal. (d) follows from the fact that F(2,2’) is a greatest lower bound 
of a family of continuous functions. - 

We remark that if the function F(z,2’) turns out to be continuous, then 
it is possible to show that (X,T') is actually equicontinuous. Thus in the 
general case, we cannot improve (d). 


Lemma 5.1. Let F(z,2’) <a. There exists e> 0 such that whenever 
F(a’,2”) <e, then F(z,2”) <a. 


Proof. Let T, denote an increasing sequence of compact subsets of T 
such that UT,—T. Consider now the orbit G(z,2’) = {(gz,g2’),g € @} 
CX XX. Suppose F(z,2’) <b<a. The subset of pairs (u, w) € G(z, 2’) 
such that d(u,u’) <b, forms a relatively open set U C G(a,2’), and since 
F(«,2’) <b, UO. We claim that there exists an n such that for any 
(wu) € (2,2), T,(u,u’) NU 4G. Suppose this were not the case. Then 
for every n we could find (un, u’,) € @(z, X) with Ty (us, Wa) C G(s, 2’) —U 
which is closed. So for m >n, Tr (Um Um) C G(2,2’) —U since Ta C Tm. 
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For some subsequence we will have (Ums Wm)—> (v,v’), and so 7',(v, 0’) 
C G(z,2’)—U. This is true for all n, so T(v, v) N U = Ø, so G(v, v) NU 
= which is impossible since U C G(v,0’) and U@. This proves the 
existence of n as asserted. 

Now recall that the mapping (r,2) > rz is continuous from T X X >Z. 
This implies that for r in the compact set Tẹ C T, the maps\r: X>X are 
equicontinuous. So there exists an e>0 such that if d(a,,%) <e, then 
d(r@, T2) <a—b for all r€ Ta. Suppose now that F(a2’,2’) <e There 
exists ro € T such that d(192’, to”) <e, and hence d(rrot’, trog”) < a—b for 
ré€7,. By the preceding paragraph, since (roz,rot’) € G(a,2’), there 
exists € Ta with (Tiro, Tiro) EU whence d(rıroz,rıroe’) <b, and so 
dlrıraz, Tiro”) <a. This proves that F(z,2”) <a as required. 


PROPOSITION 5.2. The sets U,(2) = {a’: F(a,2’) <a} form a basis of 
topology in X. 


. Proof. It must be shown that if U,(z.) N Uy(22) 4 Ø, then this inter- 
section is the union of sets of this kind. But if 2’ € U,(2,) then U.,(2’) C Ua(a:) 
by Lemma 5.1. Similarly if z’ € Uy(22), Ue(2’) C Uy(a2). So if eSe, and 
eSe, U.(2’) C Ual) N Uo (22). 

From this point on through 810, (Z, T) will denote a given subflow of 
(X, T), 2 will be a point in Z, and X, will denote the fibre Xe == m" (zo) 
where (Z, T) =#(X,T). These will be fixed throughout the discussion. 
Now let Go = {g E€ G: gX C Xo}. 


LEMMA 5.2. Let r,s € X, and gEG. If gua’ then gE Gy. 


Proof. If 2,€ Xo then v(z1)==r(£) =z Hence 7 (92s) i 
=n (z) =z, by Lemma 3.1. Therefore gr, € X, and so gX, C Xo 


PROPOSITION 5.3. Ge is a closed subgroup of G and Gy is transitive 
on Xo. i 


Proof. G, is clearly closed and a semigroup. It is a group since if 
gt = T, where x, z’ € Xo, then g'r’—=z, and by the preceding lemma, g*€ Go. 
Finally @, is transitive on X, since given any z, g’ € X, there is some ge G 
with gr==7 (G is transitive on X since (Z, T) is minimal) and by the pre- 
ceding lemma, ge Go. 


Definition 5.2. The relative topology of X, as a subset of X, and the 
relative topology of @, as a subset of @ will be referred to as the E-topologies 
on these spaces. 


Under the H-topology X, and G, sre compact Hausdorff spaces. 
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Definition 5.3. The topology of X, determined by the basis {U,(z) N Xo} 
(see Prop. 5.2) will be referred to as the F-topology on Xo. 

Definition 5.4. By the F-topology on G, we shall mean the topology 
determined by the sub-basis of sets of the form Wa(x,2’) = {g € Gy: F(z, ga’) 
<a} where VE Xo. 


PROPOSITION 6.4. a) The F-topology on X, is weaker (i.e. no stronger) 
than the E-topology. 


b) The transformations of GQ, on X, are continuous with respect to the 
F-topology. l 

c) The function F(a,2’) as a function of x’ is upper semi-continuous 
with respect to the F-topology on Xo. 

Proof. a) Since F(z,2’) is upper semi-continuous relative to the 
E-topology on Xo, Ua(x) == {2 : F(a,2’) <a} is H-open, . 

b) follows from the fact that F(gx, gz’) =F(z,r) whence gU,(x) 

=U,(g2). 

c) isa restatement of Lemma 5.1. 

As a conesquence of (b) we see that if the F- and F-topologies coincided 
on Xa then Go would act on X, by continuous transformations. The later 
developments will show that this would imply that (X,T) is already an 
isometric extension of (Z, T). Thus in general the F-topology on X, is strictly 
weaker than the E-topology. Since the latter is compact, we conclude that 
the former cannot be Hausdorff. 

Proposition 6.5. (a) the F-topology on G, is weaker than the E- 
topology. ; 

b) the maps 9 gy, 9>y9, for fixed yE Go, and the map g—>g™ are 
all continuous relative to the F-topology. 


c) For fixed sE Xo, the map g— gx of Go? Xo 18 continuous relative 
to the F-topologies on the two spaces. 


Proof. (a) follows from the fact that F(x, gx’) <d(z, ga’). 
(b) is a consequence of 
W,(2, vy =< W.(z, yr’) 
(5.1) yW.(e, T) = W, (yr, 7) 
Wa(z,2’)* = Wale’, 2), 


ail of which are consequences of the invariance of F(z,2’) under G. 


(c) {g: ge Ua(2’)} = tg: F(x, gz) <a} = Wa (7', 2). 
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If we take (Z, T) in this discussion to be the trivial flow, then Xo = X and 
G,—G. The topologies introduced are then topologies for the original space 
and the entire Ellis group. It would have been more straightforward to 
introduce the F-topologies on these. However in our discussion it will be 
necessary to treat the fiber X, (when (Z,7) is not trivial) as the total space, 
and for this reason we have introduced these topologies directly for X, and Go. 


6. The discontinuities of F(x,-). Set F,(#)=F(a,7). Here 
z,2’€ X, and Fs is a function on Xo. With respect to the H-topology (metric 
topology) on Xo, F» is an upper semi-continuous function (Prop. 5.1 (d)) 
on X, and hence its discontinuities form a set of the first category. Here the 
discontinuities are with respect to the H-topology. These form a subset of the 
discontinuities with respect to the F-topology (which is weaker). Now by 
Proposition 5.4(c), Fs is still an upper semi-continuous function relative 
to the F-topology so that the set of discontinuities with respect to the F- 
topology form a set of first category (i.e. countable union of closed nowhere 
dense sets) with respect to the F-topology. However it is not clear that for 
the F-topology (which is not metric) the first category sets are “small”— 
for example, it is not clear that the whole space X, is not of the first 
category. We shall show in this section that the two notions of first category 
in fact coincide. 


Lemma 6.1. Let A be an F-closed subset of X, which contains an E- 
open set. Then A contains an F-open set. 


Proof. Let 2 be any point in X, and set T = {g € Go: gue A}. If Ao 
is an E-open set contained in A and I, == {g E Go: gx €E Ao}, then T, is an 
E-open subset of r in Ge (83). Now the map g— gy is continuous on Go, 
for y€ G, in the H-topology of Ge. Hence Toy is Z-open for any y€ Gp. 


So U Toy is an open covering of Gy. Since G, is compact (in both topologies) 
Y&Go 


there is a finite set {y4 ' - +, yr} with U Toy: = Go and a fortiori U Eyi = Go. 
By Prop. 5.5 (e), the map g— gz, of G)— X, is continuous with respect to 
the F-topologies, and since A is F-closed, T will be F-closed. By Prop. 5.5 (b), 
the sets Ty; are also F-closed. Now let s be the smallest integer for which 


8 8-1 
= y Ty. Then Go— UT} is non-empty and F-open in @,. Hence Ty, 
=1 4=1 


contains an F-open set, and so T contains an F-open set, Too. Since multi- 
plication on the left is continuous for the F-topology on Go, it follows 


that U yoo is an open covering of Ge. Again by appropriate choice of 
YEGO 
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{Yo i -Ymy Uy’ oo = Gy, and U yT= Go: Since Gy is transitive on Xo 

(Prop. 5.3) we have TT, = A and JyYıA—X,. Now let? be the least integer 

for which U y4A =X.. As before, since A is F-closed and therefore each 
4=1 


y4A is F-closed (Prop. 5.4 (b)), we conclude that y’;A, and therefore A, 
contains an F-open set. This concludes the proof of the lemma. 


PROPOSITION 6.1. If a subset of X, is of the first category with respect 
to the F-topology then it is of first category with respect to the E-topology. 


Proof. Suppose A is a nowhere dense set relative to the F-topology. Let 
Ag and Ar denote respectively the E- and F-closures of A. Then Ag C Ar. 
If Ag contained an E-open set then Ar would contain an E-open set and by 
Lemma 6.1, Ar would contain an F-open set contrary to the hypothesis that 
A was nowhere dense in the F-topology. Hence A is nowhere dense in the 
E-topology and this proves the proposition. 

In the sequel we shall use the phrase “of first category” to refer to the 
(metric) E-topology of Xo. (We have not shown that any such set is also 
of first category in the F-topology but this will not be needed). 

We are now interested in showing that if ¢(x) is an upper semi-con- 
tinuous function on X, with respect to the F-topology, then its F-discon- 
tinuities form a set of first category. By Prop. 6.1, this will follow once it is 
shown that the set of F-discontinuities is of first category relative to the F- 
topology. This is true quite generally and is proven just as in the metric 
case. For lack of a reference we present the proof here. 

Definition 6.1. Let $ be an upper semi-continuous function on X, 
relative to the F-topology. We say that ¢ has an F-discontinuity c at zo, if 
for any e> 0, there exists z with F (zos) <e and d(z) < (a) — c. 

If for no c>0 does p have an F-discontinuity c at zo then since ¢ is 


upper semi-continuous, lim d(z)=#(7,) and & is F-continuous at z. 
F(&,50)>0 


Lemma 6.2. If $ is bounded and upper semi-continuous in the F- 


topology, the set of points at which & has F-discontinutty c> 0 ts nowhere 
dense tn the F-topology. 


Proof. Denote this set by A(c). It is easy to see that the F-closure of 
A(c) is contained in A(c—e) for any «> 0. It suffices therefore to show 
that A(c) contains no F-open set. Suppose U is an F-open set contained in 
A(c). Let a—inf{¢(z),c¢€U}. Then there exists € U with $(2,) 
<a-c/2. Moreover in every F-neighborhood of s, there are points z, with 
(21) < (21) —¢c <<a—c/2. But some F-neighborhood of 2, is contained 
in U and this contradicts the choice of « This proves the lemma. 
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The set of all F-discontinuities of ¢ is (J A(1/m), and so is of the first 
mel 
category relative to F, and by Prop. 6.1, it is of first category. In particular 


Proposition 6.2. For each z, the function Fa on X, ts continuous with 
respect to the F-topology at all points but for a set of the first category. 


PROPOSITION 6.8. Let J EX, The set of x such that F, has an F- 
discontinuity at x’ is of the first category in Xo. 


Proof. This set is the union of those æ for which Fs has an F-discon- 
tinuity 1/m at 2’, for m—1,2,3,---. It will suffice to show that each of 
these sets is nowhere dense (in the Z-topology). Let A’ be the set of z such 
that Fs has an F-discontinuity c at s’, and let A be the set of z such that for 
every «> 0, Fa has an F-discontinuity c—« at y. A’ CA, and so it suffices 
to show that A is nowhere dense. Let T= {g€ Go: gr’ €A}. Since each 
gE Qo is a homeomorphism of Xo, and F(z,2’) is invariant under Ge, it 
follows that if Fj» has F-discontinuity c—e at 2’, then Fe has an F-discon- 
tinuity c—e at ga’, and conversely. So T = {g € Co: ga’€ A*} where A* 
is the set of points at which Fy has an F-discontinuity c— e for every e> 0. 
It is easily seen that A* is F-closed and by Lemma 6.2, A* contains no F-open 
set. Since A* is F-closed, it follows by Prop. 5.5 that T> is F-closed and 
therefore also T is F-closed. Therefore T is H-closed, and so A=Tr/ is E- 
closed (but not necessarily F-closed, since an F-compact set need not be F- 
closed, the F-topology on X, not being Hausdorff). Suppose A contained an 
E-open set, then T would also contain an H-open set Ty. Now the map g—> gy 
is continuous on Qe in the E-topology, so the sets {Toy} are open and cover 
G whence G=Ty for a finite set {y} then @o = |] yT, and 
X=Uyra*. But this is impossible since the yrtA* are F-closed and 
contain no F-open sets. This shows that A and a fortiori A’ is nowhere dense 
and this proves the proposition. 


Definition 6.2. If a statement is valid for all ze X, outside of a set of 
‘the first category, we will say it holds almost everywhere (a.e.). 

The main purpose of the foregoing discussion is to obtain the following 
result. 


THEOREM 6.1. If m, in the F-topology, then Fa, (2) > Fa (T) 
almost everywhere. 


Proof: The set of 2’ such that z, is not a point of F-continuity of Fy 
is of first category. Outside this set Fo (£n) > Fe a But this is the same 
as Falz) > Fa,(2’). (Prop. 5.1 (a)). 
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7. The homogeneous space M. 


Definition %.1. For 2,22€ Xo, write zı—z, in case Falt) = F,,(2’) 
almost everywhere in X,. Let M denote the space of equivalence classes of X, 
with respect to this equivalence relation. 

That ~ is an equivalence relation is clear. We would like to show that 
the transformations of G, preserve this equivalence relation. 


Lemma 7.1. If ti~ ta then Fy,(2’) =F„(r) at all x’ which are points 
of E-continutty of both Fa and Fe, (and a fortiori points of F-continutty). 
Conversely if Fo,(2’) =F ,(2’) at points of F-continutiy then Tı — 2a. 


Proof. The set of =’ for which Fa (r) =Fa(7) is valid is E-dense if 
%,—~_. So this equality must hold at points of H-continuity by passage to 
the limit, For the converse we refer to Prop. 6.2 according to which Fs, and 
Fa are simultaneously continuous a.e. l 


PROPOSITION 7.1. If ti~ 2, then gtı ~ 92: for gE Ao. 

Proof. If F(t, x) = F(z, x) whenever 2’ is a point of F-continuity 
of Fe and Fa then F (gz, 92’) = F (gz, gx), and g being a homeomorphism 
of X, with repsect to the F-topology, the points of F-continuity of Fps, are 
the images under g of the points of F-continuity of F,,. The proposition then - 
follows from Lemma 7.1. 

Let r denote the natural map from X, onto M taking each point into 
its equivalence class. M becomes a topological space by designating as open 
the sets F for which 2o1(V) is an F-open set in X,. Then x is clearly con- 
tinuous. Although X, was not Hausdorff in the F-topology we have 


THEOREM 7.2. M is a compact Hausdorff space. 


Proof. As the continuous image of X, M is compact. Now let yı 
and y, be distinct points of M and let A, = rmo (Y1), Aa == ro (Y2). Let 
T, € Ay, T€ Ag, and form the F-neighborhoods U.(a,) and U,(x2) (Ue(%) 
= {z: F(z s) <e}). Suppose these sets overlapped for every «>0. We 
could then find a sequence mE Ui/s (21) N Uryn(2a) so that uaz, and 
tl, —> T: in the sense of the F-topology on Xo. But then, by Theorem 6.4, 
Fy, Fo, and Fe > Fa 2.0. 80 that Fo = Fo, 2.6. and 4,~2,. This would 
imply Yı = ro (21) = ro (22) = Y2 contrary to our hypothesis. The conclusion 
is that any point of A, can be separated from any point of A, by non-over- 
lapping F-open sets. 

Next we notice that A, and A, are compact. For suppose a’,~2, and 
„> x in the F-topology. Then Fy,> Fy a.o. But Fy, = Fe, a.e. whence 
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Fy = Fa 2.6. and T~ 2, EA. So A, is closed and hence compact. The 
game holds for Ay. Since we can separate any pair of points from A, and A, 
by non-overlapping F-open sets, a standard argument shows that there exist 
F-open sets U, and U: with Ai C Ui, Ay C Uz and U, N U: = Ø. (The same 
argument used to prove that a compact Hausdorff space is normal). Let U’, 
denote the set of points not equivalent (~) to any point outside U, and 
define U’, similarly. Then A, C U’, C U, and A, C U’, C Uz. We claim that 
U’, and U’, are F-open. Suppose usg U’, and u,—>u in the F-topology. 
There will exist v, € U, with u,—,. Passing to a subsequence of the original 
sequence we may suppose that v, converges in the F-topology, say to v. (In 
fact if v,—v in the H-topology, then »—v in the F-topology). We then 
have Fu, > Fu a. e. and Fo, > Fo a.e. and Fu, = Fo, a.e., whence Fy — F, a. 0. 
andu~v. But vg U, so wg U's, and this proves that U’, is F-open. The 
same argument shows that U’, is F-open. Now any point equivalent to a 
point of U’, is clearly in U’;. We find then that mo "m (U’.) — U’, and simi- 
larly mo 'm,(U’,) =U’. This implies that m,(U’,) and m,(U’,) are disjoint 
open sets in M. Finally yı =r, (21) € ms(U’,) and yz€ m,(U’,) which proves 
that M is Hausdorff. 


Definition 7.2. For gE Go, let O(g) denote the transformation of M 
defined by 


(7.1) (9) 70(%) =r (g7). 
where ze Xo. 


This definition is unambiguous since by Prop. 7.1, if 221%, also 


rogTı = To] T2. 


Definition 7.3. Let H be the group (Gu). We define a topology on H 
by designating as open the sets W for which 67*(W) is F-open in @.. 


PROPOSITION 7.3. If ha€ H, the operations h— hh, and h— hoh are 
continuous on H. If yE M, the map h— hy is continuous from H to M. 
Finally, the group H is compact and Hausdorff. 


Proof. Let W be an open set in H and set ho = 0 (go). Now 6(g)ho€ W 
is equivalent to 6(g)@(go) € W or O(ggo) € W, 99€ O7(W). The latter set 
is F-open and so is 6*(W)go*. This shows that @*{h: hho € W} =67(W) go 
is F-open and so {h: hho € W} is open and h—> hh, is continuous. A similar 
argument applies to h—> hoh. We have used here the fact that both left and 
right multiplications are continuous for the F-topology on Ge. Now let V 
be open in M and let y==m(z). {g: 0(g)mo(t) € V} = {g: mo(gz) € Y} 
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—{g: g€ ro*(V)}. Since rot(V) is F-open in Xo, this set of g is F-open 
in Go. Hence #*{h: hy € V} is F-open in G, and so {h: hy€ V} is open in 
H and k— hy is continuous. Since H is the continuous image of G, it is 
compact. To prove it is Hausdorff suppose for a pair of elements in H, 
hı>&h.. There exists a point yo such that hiyo AAsyo. Since M is Hausdorff 
we can find two open sets V, and V; in M, with Ayyo€ Vi, Aeyo€ Vz and 
ViN Ve=@. Set Wi = {h: hyo€ Vi}, Wa {h: hyo € Vo}. Since ho hyo 
is continuous W, and W, are open in H. Clearly hye Wi, khac Wa and 
Wi W= Ø. This completes the proof of the proposition. 
The following result is due to Ellis ([5]). 


Proposition 7.4. Let H be a group which is provided with a topology 
for which H ts compact, Hausdorff and for which left and right multiplication 
are continuous. Then H is a topological group; i.e. the map (hi, ha) > Asha 
is continuous from H X HH. More generally, if H operates on a compact 
Hausdorff space M in such a way that for he H, y€ M, hy is separately con- 
tinuous in h and in y, then hy is a continuous; 4.6. (h,y)—> hy is a 
continuous map from H X M > M. 


Since the hypotheses of this proposition are verified in our case of Prop. 
7.8, we conclude that H is a compact topological group the map (h, y) > hy 
. is continuous from H X M to M. Now, since X, has a countable base for its 
topology so does M, and being compact Hausdorff, M is metrizable. Let 
D’(y:, 42) denote a metric. We claim that 


D(y1, 92) =e (hyi kya) 


is an equivalent metric on M. Clearly it is a metric; to show it is equivalent 
we need to show that for y, € M and e> 0, there is a neighborhood V of yo 
with D (y, Yo) <€ for y€ V. Now by what we have shown, D’(hy, hyo) is a 
continuous function of the pair (h,y)€ H X M. It vanishes on H X yo, 80 
there is a finite covering of H X Yo by open sets of the form W; X V; on which 
this function <e/2. Take V =N Vy, then for y€ V, D’(hy, hyo) < €/2 for 
all h and so D(y,yo) Se/2<«. This shows that D may be taken as the 
metric on M. Since D(41,y2) = D(hyı,hys) we have 


THEOREM 7.5. M is a homogeneous compact metric space and H acts 
transitively on M by isometries. 


Proof. We need only remark that H is transitive un M because G, is 
transitive on Xs. Hence M is homogeneous. 
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THEOREM 7.6. M will not reduce to a single point unless the fibre X, 
consisted of just one point. 

Proof. If M consisted of one point, then 2, —2, for all pairs of points 
in X, and F(z, 2) = F (2,2) a.e. Now let zz, while ranging over the 
simultaneous points of continuity of Fa and Fe. Then lim F(z,2)—0. If; 
in addition, z, is a point of continuity of Fe then lim F(a2,¢) =F (2s, 2%), 
so that F (22,21) ==0, or T, =% Since almost all points of X, are points 
of continuity of Fa, this implies that X,— {x2} is a set of the first category. 
This can only take place if X, reduces to a single point. 

Definition 7.4. By a semi-metric on a space Q we mean a function 
o(101, W2) on Q X Q satisfying 
(i) o(w, w:) 20, (i) o(W ws) S o (W W) +o (Wz, Ws), 
(ii) o(w1, wz) =o (W, w1), (iv) o(w,, w) =0. 
(o is a metric except that it may vanish for distinct points). 
Definition 7.5. Let o(£1, %3) be given by 
o (21, Z2) = D (mo (21), To (£2) ). 
` Insofar as they will be applied in the sequel, the results of the last two 
sections may be summarized by the following theorem. 

THuorem Y.Y. If (X,T) is a non-trivial extension of (Z,T) and X, 
is a fibre of X with respect to Z, G, ts the subgroup of the Ellis group taking 
Xo into itself, then there extsts a non-constant function o (21,23) on Xo X Xo 
such that fee” l 

(a) olt, t) is a semi-metric on Xo, 

(b) o(g21, ga) = o (T1, T2) for gE Go, 

(c) (21,22) is continuous with respect to the F-topology on Xu; more 

precisely - . 
(d) for any «>0, there is a d such that whenever F(q, %2) < 8, 
o (Ti, T3) <e 

Proof. (a) and (b) follow directly from the definition of o. (c) follows 
from (d) so we proceed to prove the latter. Suppose (d) were not valid and 
there existed pairs (2, 2,®) with F(2,™, 2,9) > 0 and o(2, 24) Ze. 
Both F and o are invariant under Gs; applying an appropriate g™ to 2, and 
T") we may assume that z,“) is independent of n, say 22“) == z}. But then 
x,” —> T in the F-topology and so 2(2,%)) > ro (22) in M and o(2,"), x2) 
=D(m(zı®), mo(23)) tends to 0. This completes the proof of the theorem. 
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It might be pointed out that if (Z, T) is the trivial flow, then our argu- 
ment could stop at this point. X, would then be X and M would be an 
identication space of X, and we would have that (M, 7) is a subflow of (X,T). 
Since H acts on M by isometries, T does so also. We have thus shown that 
every minimal distal flow has a non-trivial equicontinuous. subflow. Our 
purpose in the next three sections is to extend what we have found for the 
single fibre X, to the entire space X. 


8. The map % is open. In this section we prove a lemma which implies 
that if (X, T) is minimal distal and (Z, T) —r(X,T) is any subflow, then 
the map +: X—>Z is an open map. This will be used repeatedly in the sub- 
sequent sections. 


Lemma 8.1. For any «>0 and zEZ, there exists a finite subset 
X CX,(==a1(z)) such that for each g in the Ellis group of (X,T), the 
finite set g& is e-dense in gX, (That is, every point in gX, is at a distance 
<e from some point of g2.) 


Proof. Such a set could certainly be chosen so that this condition be 
satisfied for one g; just take 4 — g1% where 3/ is an e-dense subset of gX, 
(Recall Lemma 3.1 according to which g takes fibres over Z with fibres over 
Z.) For each g, then, let %(g) denote such a set, but for e/3 instead of e. 
Let zo be any point in X, and set Ws(gi) = {g: 4(g20, 91%.) <8} where gı 
is some fixed member of G. Ws is then an E-open neighborhood of g,. We 
claim that for sufficiently small ô, every point of gX, is within a distance e/3 
of a point of g.X, if g€ Ws(g.). TE this were not the case we could find a 
sequence L'n € 9X, With d(g'n%, 91%) > 0 and 2’, no closer than «/3 to any 
point of g,X,. Passing to a subsequence we may suppose that 2,2’. 
Then 2 ¢ g,X,. Now let m be the map from X to Z. Since 2’, € gu, 
1 (2_) =r(gı%) > x(g). Since p> 2’, w(Z_) > 2(2’) 80 2(2’) = 1 (g1%0) 
which implies that € gX, This is a contradiction, and so for each gı, 
5 exists as asserted. (8 may depend on gı). Next let 


W'(91) = {g: d( gu, gu) <e/3 for every u€ %(g:)}. 


W’(g,) is again an E-open set. Take g€ W’(g.) N Wa(gı) where 8 is chosen 
as above. If zEgX, then z is within «/3 of some point 2, in X, 2 in 
turn is within «/3 of a point giu where u€ (gı). Finally gıu is within e/3 
of gu, so z is within e of gu. This shows that %(g,) fulfills the condition of 
the lemma for an E-open set about go. These open sets cover G, so a finite 
subset will do, say the sets corresponding to &(), t=1,---,m. If we 
take 3==U %(g,), then for every g, g3% will be e-dense in gX,. 
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THEOREM 8.1. If (X,T) ts distal and (Z,T) is minimal where 
(Z,T)=#(X,T) then the map m: X>Z is open. 


Proof. Let V be an open set in X, we wish to prove that (V) is open. 
If this were not the case we would have a sequence {zn} in Z with» 2 € (V) 
and Zn É w(V). Letz=r(z), s€ V and suppose that V contains an e-neigh- 
borhood of z. Since (Z, T) is minimal, G is transitive on the fibres of X 
(Corollary to Theorem 3.2). We may therefore write Z, =r (gno) where zo 
is some point of X. Now let X, be the fibre passing through a, Xo = m*r (T9), 
and let X be a finite subset of X, with gX e-dence in gX, for every g. Passing 
to a subsequence, if necessary, we may suppose that g, converges for each 
w€3. The limits may be written as gu for some g€ G (3 corresponds to a 
point in a product X”, X= (t,:- +, Um), and G (th, * *, Um) is compact). 
Now if we 3, (gu) —=7(gaTo) since (u) —=a2(2o), 80 (U) =z, > z. 
Therefore r(gu) ==z. Since r(z) =z and gu € gXo, we have ze gX.. Hence 
x is within e of some gu, u€ 3. Since g,u— gu, it follows that for n suff- 
ciently large, gau is within « of z; hence gu € V. But then Za == r (gau) € (V) 
contrary to our assumption. This shows that m is open. 


COROLLARY. If {22} is a sequence in Z with 2,2 and n(x) —z, then 
there exists a sequence {Tn} with x(t.) = Za and Iya. 


Proof. Let e— 0, and let Vy be an es-neighborhood of x. Since r(Vx) 
is open, there is an N, with 2,€ (Vz) for n > Ny. Here we may suppose that 
N» is an increasing sequence. Then for N < n S Npn let £n € Ve N (Zn). 
Clearly „x and (tq) = Zp. 


9. The function R(x,, x). 


Definition 9.1. If z,2,€EX are in the same fibre over Z, i.e. 
(2) =r (T2), then set 9(21, T2) = o (J21, 92.) where o is the function on 
Xo X Xo of Definition 7.5, and g€ G is such that gz, € Xo. 


Since (X, T) is minimal, such a g exists. Now if gz, € X, and g'z, € Xo, 
then g’g* takes a point of X, into a point of Xo. By Lemma 5.2, g’g*€ Qo. 
Hence, using Theorem 7.7 (b), 

o( 921; 92) — o (J'E, JJJ) = 0( Gtr, gar). 
This shows that Def. 9.1 is unambiguous. 
Definition 9.2. For Tı, 22€ X, r#()—=r(2,) let 


(9.1) R(T, t2) = limsup S (tn, uz). 
(trta) (21:00) 
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Proposition 9.1. (a) R(z,2,) is an upper semi-continuous function 
of the pair (21,2). 

(b) R( gtr; 9t2) = B (21,22) if gel. 

(c) For fiwed 2€Z, the restriction of R to XX X, defines a semi- 
metric on Xs 

(d) For every e there is a8 such that whenever 2, £a, X, T'a are in the 
same fibre and d(a,,2’,) <8, d(2, 2°) <8 then | R(a,%2) —R(#'s,22)| <€ 


Proof. For (a) we recall that if ¢ is an arbitrary function on a topological 
space and y(z) ==limsup¢(u), then y(z) is upper semi-continuous. 
ia 


To prove (b) we notice that S (s, 22) is invariant under G. In particular 
D (781,702) = S (21,2) for rE T. Now if (tt, U2) > (2,273) then (rt, TUe) 
— (r%,72,) by the continuity of +, and from this it follows by (9.1) that 
R(t, T23) =R (21, 23). Now for any g, (gt, gza) is a limit of a sequence 
(TaT, TnT); 80 by (a), R(ga., 9%) = R (Tu 2:2). Applying the same argu- 
ment to g* we see that we must have R(gzı, 92%) = R (m, 22). 

(c). By Theorem 7.7 (a), o(21,2,) defines a semi-metric on Xo. It 
follows that S (a, Ta) defines a semi-metric on each. fibre. We wish to show 
that the same holds for (£1, z2). It is only necessary to establish the triangle 
inequality. So let Tı, a,€ X. We can find (Un, Wa) > (Sı, Z3) with 
B (tn, Wa) > R( 23,25). Let Za == r (tn) =r (Wn). Then 2 2(22). By the — 
corollary to Theorem 8.1, there is a sequence {v,} in X with „oz, and 
(Un) == Za. Then Us, Un, Wya are on one fibre and I (un, Wn) SS (Un, Un) 
+ S(vs, Wn). Letting n>» we find R(z,2%) S R (Tu 22) + R (Ta, £8) 88 
was to be shown. 

For the proof of (d), since R (z1, %2) is a semi-metric, it suffices to show 
that for some 8 if d(z1,25) <8 where r(z,)=#(2,), then R(21, %2) <e 
Let ö be chosen in accordance with Theorem 7.7 (d); that is, F (t, Us) <8 
for t, Ua € X, implies that o (ta, U2) < e Now if d(z,,2,) < 8, then a fortiori 
F (£1, £a) <8. IE (a, we) > (T1, 22) then lim sup F(u m, u)) <8. We 
may suppose that R(2,, 22) = lim § (#1, u,®) = lim o (Yu), gate) where 
the ga are chosen so that gnu, € Xo. Since , 


lim sup F (gnt,, gata) == lim sup F(u,, u) < 8 


it follows that limo(gnti™, gnu) <e. This completes the proof of the 
proposition. 
We now strengthen (a) of the foregoing proposition. 


PROPOSITION 9.2. R(z,2,) is a continuous function on the subset of 
XXX defined by »(2.) == r (%3). 
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Proof. Let X* denote the closed subset of X X X of pairs (z1, %2) with 
(&)—=r#(2). The flow (X*,T) is defined as a component of the flow 
(X x X,T), and the Ellis group for this flow is G. (83). Let 7*(a%, T2) 
—r(2,), so that (Z, T) =27*(X*,T). The function R(z,,2,) is an upper 
semi-continuous function on X* and so it has points of continuity in every 
relatively open set of X*. Let A, denote the set of points at which Æ has 
discontinuity a: 

(9.2) Ay {a* € X*: R(c*) — lim inf R(u*) 2 a}. 


A, is a closed set. Since R(ra*) = R(z*) for 7€ T, it follows that TA, C Ag. 
Thus (Ag, T) is again a distal flow. Since (Z,T) is minimal, if A, is non- 
empty we must have Z=r*(A,), so that (Z,T) is a subflow of (Aa T). 
Now if R is not continuous then some A, is, in fact, non-empty. 

Define a metric d* in X* by 


d* ( (Er, La), (T'i T2) ) = d (2s, 1) + d (x2, 2'2). 
Also, for § > 0, set 
= {ste X*: Ja,” € A, with r* (21) = nr (z>) and d*(a,*,2*) < 8}. 
Clearly Ag C Ag’. We shall show that A,? contain a neighborhood of each 
point To” E€ Ag. Suppose then that c,* —> z,*; then »* (2,*) > *(zo*). Now 
because (Z, T) is minimal, and (Aq, T) is distal, we may apply Theorem 8.1 
and its corollary to the map 7*. We conclude that there exists a sequence 
{unt}, With Unë — Tot, rl) = 2" (Tn) and mrE Ag. Since (Unt, Tr") 
—> (To, 2"), d*(uUy*, 2%) 0, which shows that ultimately m? € A,°. 
By Proposition 9.1 (d), there exists a 8 such that if r*(u*) =x +(y*) 

„| and d*(u*,v*) <8, then | R(u*)—R(v*)| <a/4. Form A for this ô. 

A, contains an open set of X* and so R will have a point u* of continuity 
in A. Then there is an #* € A, with r*(c*) =*(u*) and d*(u*,z*) <8. 
Since z*€ Ag, there is a sequence 2*—>2z* with lim R(z,*) <R(z*) —a. 
Now apply the corollary to Theorem 8.1 to the map 7*: X*>Z. Since 
(+) > r? (2*) = n* (u*), we can find m* > u* with r*(u,*) = nt (2u*). 
Then (tn*,2,*) > (u*,2*) and since d*(u*,2*) <8, ultimately d* (un*, a") 
<8, and also R(u,*) < R(x,*) + 4/4 < R(x*) —8a/4 < R(u*) —a/2. 
Since u,*—> u* and R is continuous at u*, this is a contradiction. This proves 
pa A, must be empty and R is everywhere continuous. 


- Proposition 10.3. If (X,T) is a non-trivial extension of (Z,T), then 
the function R(a1,22) does not reduce to a constant. 


Proof. If R(z,, £3) is constant it vanishes Semat: But on Xo, 
R (2, 22) = 8 (21,22) =o (T1, T2), and this will not vanish everywhere unless 
M reduces to a single pt. The proposition now follows from Theorem Y. 6. 
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10. Construction of (Y,T). We have (X, T) = (Z,T) and for pairs 
of points Tı, £a € X with r(z,) = ~r (z2), there is defined a function R (z1, ze) 
satisfying the following: 


(10.1) (a) R is a continuous function. 
(b) On each fibre of X with respect to Z, R defines a semi-metric. 
(c) For each g€ G, R( gt, 9%) = R (T1, t2). 
(d) R is not constant. 


Since R is a semi-metric it is natural to introduce an equivalence relation: 
Tı Xg if r(e,) =r(z:) and R(zı, z1) =0. It is clear that this is an 
equivalence relation. Moreover by (c) we shall have tı ~ 2, implies gx, ~ gTa. 
Let Y denote the set of equivalence classes for this relation, and let m, be 
the natural map mı: X —> Y taking each point of X into its equivalence class. 
Since z, and z, are equivalent only if r(z,) =#(2,), we may define a map 
m: YZ by 


(10. 2) aa (a1 (2) ) —=r(?). 
We then have 

Ti T2 
(10.8) X — Y —Z 


and TOT, =T. 

We endow Y with a topology by designating U C Y as open if and only 
if (U) is open in X. Then ~, is also continuous. ~e is also continuous, 
since 7: *(42*(W)) =274(W), so if W is open in Z, 1.1(W) is open in F. . 


Proposition 10.1. Y ts a compact, Hausdorff space. 


Proof. Since m, is continuous, Y is compact. To prove it is Hausdorff, 
suppose 4:,42€ Y and y;+442. Suppose first that w2(y:) Ars(ys). Then 
since Z is a Hausdorff space we can separate 7,(y,) and 2(y2) by open sets 
W, and W, with W, nN W= Ø, and since m, is continuous 7.1(1W,) and 
w2*(W2) are again open nonoverlapping sets in Y which separate y, and ya- 
So we may confine ourselves to the case me (41) —=72(y2). Let A, == m! (41), 
A,—=7,"(Y2). Since yı ~ y: there is a constant a > 0 such that R (z, 22) =a 
for any z, € A, and € Ae. Since R(&,,22) is continuous we may enclose A, 
in an open set Uy, and A, in U, such that R (un, Uz) > 0/2 whenever u, € U, 
WE Uz. Now let V, be the set of points not equivalent (~) to any point out- 
side of U,, and define F, analogously. Clearly A; C V, C Uy, Ag C Ve C Uo. 
We claim that V, and V, are open. For if Un V, and v, > v then Un—~ Un É U. 
Passing to a subsequence we may suppose that un—> u. u€ U, since U, is open. 
Then R(u, v) =lim R (un, vn) =0 so that u~v and vg V,. This shows that 


12 
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V, is open and similarly V, is open. Also any point equivalent to a point 
of V, is clearly in Vy, so mı!(m(Vı))—=V;; similarly r” (m2(V3)) = Vo. 
Hence 7,(V,) and 7,(V2) are open in F, m(Vi) Nmı(V:)==Ø (since 
Vin V= Ø) and y:€7:(Vi), y2€a1(V2). This completes the proof. 

Let X, be a fibre of X over Z. Let Yo==7,(X_) be its image in Y. 
In Y, we define a metric by 


(10. 4) lm (21), 71 (22) ) = R(m, T2) Tı; T2 € Xo. 


This is unambiguous since R(2,,2’,) = 0 and R(z,, 2’) = 0 implies R (x1, £2) 

‘== R(2’,,2’2). Since R defined a semi-metric in X, it follows that p defines 

a metric in Yo. (The continuity of p is a consequence of the continuity of R.) 
Now let Go={g: gX C Xo}. For each ge G we may define w(g) 

on Y by f 

(10. 5) w(g)mi (2) =m (ge) 


and this is unambiguous since Tı ~ Te implies gz,~ gt} Let Hy = w (o). 
Then H, takes Y, into itself. We claim that H, acts on Y, by isometries. 
For 
p(w (g) mi (21), (gar (22) ) = p (m1 (921), m: (922) 
= E(g2,, 92) = R (a1, 2) = p (m1 (21), 71 (T2) ). 


Moreover since (7, is transitive on Xo, H, will be transitive on Yo. Thus F, 
is a homogeneous, compact metric space. 

Since T acts on X continuously, it may be seen that T acts on Y con- 
tinuously. For let tar, m>y and wn)mn>Y. Let Ys =r (Tr). 
Passing to a subsequence we may suppose that „rin X. Then y =m (g). 


W(t) Yn =w (ta) 71 (Zn) =T (Tata) > m (rT) = w(r)m (2) =w(r)y, 


or y = w(r)y. This shows that whenever ,— T, Yn —> Y, then w(rn)Yn—> w(r)Y. 
If we now define the action of T on Y by sy=w(r)y, then it follows that 
(Y,7) is a flow. 


THEoREM 10.2. Y is a Y,-bundle over Z and (Y,T) is an isometric 
extension of (Z,T). 


Proof. To show that Y is a Y,-bundle over Z, it is necessary to show 
the existence of a function p(yı, Y2) satisfying the conditions of Def. 2.1. 
We define p by (10.4). It is then continuous and defines a metric on each 
fibre of FY over Z. Since R (gz, 92) = R(2,, £2), it follows that p is invariant 
under w(@). w(@) is transitive on Y: since @ is transitive on X ((X,T) is 
minimal), and this shows that each fibre is isometric to Fo. This shows that 
Y is a Y,-bundle over Z. ` 
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We have (Z,T)==72(¥Y,T). To show that (Y,T) is an isometric 
extension of (Y, 7) it is necessary to show that p is invariant under T. But 
p is invariant under w(@) and the operations of T correspond to w(T)C w(@). 
This completes the proof of the theorem. 

Let us observe that under (10.1d), (Y, T) is a non-trivial extension of 
(Z,T). For Y, cannot reduce to a single point unless R vanishes identically. 
We have thereby proved 

THEOREM 10.3. If (X,T) is a minimal distal flow, and (Z,T) is a 
proper subflow, then there exists a subflow (Y,T) of (X,T) which is a non- 
trivial isometric extension of (Z,T). 


Combining this with Theorem 4.2 we have proved 


THEOREM 2.4. Every minimal distal flow is quasi-isometric. 


11. The Abelian case and eigenfunctions of a flow. When the group T 
is abelian then there is an alternative approach to the proof of Theorem 2. 4 
which we shall indicate in this section. This approach does not actually yield 
a complete proof of Theorem 2.4 even in this case. Nevertheless it is of 
some interest as far as it goes. 

If (X,T) is a quasi-isometric flow, then it is obtained by a succession 
(possibly transfinite) of isometric extensions from the trivial flow. Let (X,,T) 
denote the first such extension (which is non-trivial), so that (X,, T)=r.(X,T) 
is an isometric extension of the trivial flow. Clearly this means that T acts 
on X, by isometries. The Ellis group of (X,,T) is then a compact group 
of isometries of X,. If T is abelian then this group is abelian and X, itself 
is a compact abelian group and T acts by rotations. Let ¢ denote a character 
on the group X,. Imbedding T in X, we have (tr) = (7) $(x) where rET, 
c€X,. Thus ¢ is an eigenfunction of every transformation of T. If we set 
(z) = (71(2)) we will have (rr) = ¢(r)®(z). Thus if (X,T) isa q.i. 
flow and T is abelian, there exist non-constant continuous eigenfunctions for 
the flow. It is possible to show conversely that if a flow (X, T) possesses non- 
constant continuous eigenfunctions, then it has a non-trivial subflow (X, T) 
which is equicontinuous, i.e. an isometric extension of the trivial flow. 

We will now show directly (i.e. without invoking Theorem 2.4) that if 
(X, 7) is a minimal distal flow, it possesses non-constant continuous eigen- 
functions, if T is abelian. 

Let M be the set of non-negative regular Borel measures on X satisfying 
p(X) =—=1. M is a convex set which is compact with respect to the weak” 
topology of M as a subset of the dual space to C (X), the continuous functions 
on &. Define rp by 


S f(x) dry (x) — ff (rz) du(e). 
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This is an affine transformation of M—>M. By the Markov-Kakutani fixed 
point theorem ([3]) there exists some measure p satisfying su—p for all 
7€ T, if T is abelian. » will henceforth denote an invariant measure. Form 
the Hilbert space L*(X,») and define the operator A by 


(11.1) Af (x) — fF(2,y)f(y) de(y) 
where F is the function defined in § 5. 

` Since F(a, y) =F (y, x) and F(z,y) is bounded, A is a self adjoint 
Hilbert-Schmidt operator. For each r€ T define the operator L, by L-f(z) 
e=f(rv). We have then 


AL, f(z) = fF (a, y)f (ry) ah(y) 
— fF (ra, ry) f (ry) du(y) = fF (ra, 9) f(y) arn (y) 
= fF (rz,y) f(y) du(y) = L,Af(2). 


So each L, commutes with A. In addition each L, is a unitary operator on 
L?(X,»). Now by the theory of completely continuous operators ([81), 
L? (X, p) decomposes with a direct sum 


L (X, p) =H, Q En OH, D DOHnmnD 


where H, denotes the set of elements f€ IF (X, p) for which Af—aAf. Each 
of the spaces H), for A4=40, is finite dimensional. Since the L, commutes 
with A, each L, takes H, into Hy, and so T' maps into a commutative group. 
of unitary operators on a finite dimensional space Hy (A340). This means 
that H, has a basis consisting of eigenfunctions for all the L,. Now it 
is also known that the kernel F(z,y) of A can be approximated in 
L?(X XX,» Xp») by sums of products of functions in the various Hı with 
430. So unless F is almost everywhere (measure theoretically) a constant, 
the H, for some 40 will have positive dimensions and the L, will possess 
non-constant eigenfunctions. These will be measurable eigenfunctions of the 
flow. Now if F(z, y) is constant almost everywhere, since F(z, y) < d(z,y) < € 
on a set of positive measure, if « > 0, it follows that F(z,y)—0a.e. But 
then, unless X is trivial, there must be pairs of distinct points z and y with 
F(z,y) = 0, contrary to supposition. This proves the existence of measur- 
able eigenfunctions. 
Now if € Hy, A320 then it has a ER EN as a function in the 
first Baire class: 
e(z) I" fF (z, y)¢(y)da(y) 


since F is upper semi-continuous. A result of Kakutani (unpublished) implies 
that if & is an eigenfunction of a minimal flow then ¢ is continuous. In fact 
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if & had a discontinuity at z, since (rr) =#(r)$(z), | 6(7)| = 1, it follows 
that it has a discontinuity of the same magnitude at re. Hence it has a 
discontinuity of this magnitude on a dense set, and therefore ¢ has no points 
of continuity. Since this cannot happen if ¢ belongs to the first Baire class, 
¢ must be continuous everywhere. This establishes our assertion. 

In case (X, T) is not just minimal, distal, but also strictly ergodic (i. e. 
the invariant measure p is unique), this method may be extended to show 
that (X,T) is a quasi-isometric flow. This is done by showing that each, 
subflow (Z, T} of (X, T) possesses a non-trivial isometric extension in (X, T). 
This extension is obtained by studying operators A, defined on each fibre of X 
over Z in a manner similar to (11.1). This method could be used in the 
non-abelian case if we knew that whenever (X,T) is distal, there is some 
invariant measure „u for T on X. As a matter of fact, this is the case, as we 
will show in the next section. However the proof depends upon Theorem 2.4, 
so this does not yield an alternative proof of that theorem. In any case, this 
procedure has only been successful if we add the hypothesis of strict ergodicity. 

An interesting consequence of the existence of eigenfunctions on X when 
(X,T) is minimal distal is the following: 


THEOREM 11.1. If X is simply connected, then X does not admit of a 
minimal distal flow for any locally compact abelian group T. 


Proof. If (X,T) is minimal distal, there exists a non-constant con- 
tinuous map ® of X into the unit circle with &(rz) = ¢(r)®(#) for ze x, 
TET. If X is simply connected, we may write $(z) = 6) where y(x) is 
real valued and continuous on X. Then 


et ¥(re)-1e)] m oh (7). 


Since y (rx) —y (x) is continuous, as a-function of z, it must be constant for 
each r. Since y is bounded, this implies y (rz) =y (æ) for each v and r. But 
then y is constant and so also is $. This proves the theorem. i 

In particular, the n-sphere, for n > 1, cannot support a minimal distal 
flow. 


12. Existence of an invariant measure for a distal flow. In this 
section we shall show that if T is a locally compact group of homeomorphisms 
of a compact metric space such that (X,7') is a distal flow, then there exists 
on X a non-negative Borel measure which is left fixed by T. 

It is necessary to elaborate on some of the notions referred to in the 
preceding section. Let C(X) denote the Banach space of continuous functions 
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on X with the sup norm. The dual space C*(X) may be identified with the 
set of Borel measures on X. Namely if » is a (Borel) measure on X we set 


(12.1) ES He) aCe). 


Now let r be homeomorphism of X. For every f € a we set (2) =f (rx). 
Tf „€ C*(X) we define rp by 


(12.2) fu. 


We say p is invariant (under T) if ru==p for all rE T. In the space of 
measures C'*(X) we shall not be concerned with the norm topology, but rather 
with the weak* topology. That is, we say p„—>p if, for each fe C(X), 
pa(f) > »(f). We shall say that ne C*(X) is a probability measure on X if 
pZ 0 and p(X) —1. 


Lemma 12.1. Let M be a homogeneous compact metric space. There 
is a unique probability measure p on M satisfying yp =a p for every isometry 
y of M. 


Proof. Let T be the compact group of isometries of M and let m denote 
the normalized Haar measure on T. For each se M define m€ C*(M) by 
malf) — f, f(ye)dm(y). Since m is right invariant, mys = ms for YET. 


Since T is transitive, nes = my for any s, y € M. Since m is left invariant, 
m, is invariant under T. Denote the common measure m, by u. Now suppose 
that x’ is any probability measure invariant under T. Then 


CDS OKO f OO — Sef, He ane) am 
— f, f send (2) am(y) -f m,(f) dg (2) = p(f). 


This proves the lemma. 


Proposıtion 12.1. Suppose (Y, T) isa flow such that T leaves invariant 
a probability measure on Y. If (X,T) is an isometric extension of (Y, T), 
then T leaves invariant a probability measure on X. 


Proof. Let X be an M-bundle over Y and suppose (F, T) —7(X,T). 
Each fibre X, of X over Y is isometric to M and hence possesses a unique 
probability measure invariant under its isometries. Denote this measure by 
My. Each uy is a measure on XD Xy. Now let r€ T and consider the measure 
thy. Since rXy C Xzy, ty. is concentrated on Xy. Suppose that y is an 
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isometry of X7,. By Definition 2.2, it follows that r is an isometry of X, 
onto X;,. Hence r yr is an isometry of X, and so r*ytpy = py, OF YThy = Thy. 
So ruy is a probability measure on X,, invariant under every isometry of Xry. 
Hence thy = pry. 

Next we shall show that py is a continuous function from Y to C*(X) 
relative to the weak* topology of the latter. Namely suppose y,—>y. For 
each n let yn: X,— Xp, be an isometry. As maps of X,—> X the yn are equi- 
continuous and so, passing to a subsequence and renumbering, we may suppose 
that ya — y uniformly. y will take X, into itself. Let p define the metric on 
the fibres of X with respect to Y. Then p(ya%1, Ynte) = p (T1, T2), and since 
p is continuous, p(yZı, yZ2) = p(t, 22), and we see that y is an isometry of Xy. 
Passing to a further subsequence of {y,} we may suppose that py, converges, 
say to x. Let # be an isometry of X,. Then ysy’yn* is an isometry of Xy, 
so that yay’yn By, == py, Since yn — y uniformly, ysy yat > yyy? uniformly 
and since py, > K, Yny Yn Pn > YY yw Thus yyy tp! =p or yy tw = ye’, 
and ya’ is invariant under any isometry of X,. Hence w == ytu and p 
must be identical with py What we have shown is that if „—y and py, 
converges, the limit must be uy. Since the probability measures on X form 
a compact set, it follows that a, is a continuous map from F to C*(X). 

Now let v denote an invariant probability measure on Y. We define a 
measure on X by setting 


(12.3) v(p) = fuy(p)d (y). 

The integrand is a continuous function of y and so the integral in (12.3) 
is well-defined. It is readily verified that this defines a positive linear func- 
tional on C(X) with v(1) = 1, so that v is a probability measure. We claim 
that v is invariant under T. Let reT: 


tv(h) =r ($7) = feul) de (y) = frpy($) dv(y) 
= fury (b) dv(y) = fulh) dhg) = fulh) do(y 
=v(¢). 
This completes the proof of the proposition. 
Suppose m is a continuous map of X into Y. For any fEC(Y) set 
f*(z) = f(rv). Then if u is a measure on X let rz be defined by mu(f) = p(f*). 


Lemma 12.2. Let (X,T) be a flow and p a measure on X invar iant 
under T. If (Y,T)=r(X, =) is a subflow, then mp is a measure on Y 
invariant under T. 


Proof. First we remark that for re T, (f7)" = (f*)%, since for z€ X, 
(tz) == xr(rr). It follows that rra == rrp. But sung 80 mru = ny and 
rrp = nyu. This proves the lemma. 
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PROPOSITION 12.2. Let Z be a totally ordered family of subflows 
{(Xa,T)} of (X, T) such that (X,T) is a limit of the flows of % (Def. 2.3). 
If for each a, Xa carries a probably measure invariant under T, then X 
does so as well. 


Proof. Let A be the index set for 2:3 {(Xa,T'),a€ A} so that A is 
a totally ordered set, and if a, 8€ A, a>, then (X,T)< (Xa, T). Suppose 
(Xa, T) =ra(X, T). H «> Bs there is a map ng: Xa—>Xg with 
= Tp“ O Ta. 

Let va be a probability map on X« invariant under T. va€ C*¥(Xa), and 
the map ff” imbeds C (Xa) in C(X). So ve is a linear functional of 
norm 1 defined on a subspace of C(X). It extends to some linear functional 
on all of C(X) without increasing its norm. Let va denote this extension. 
Then va(1) =1 and [7a | —1 which implies that v is a probability measure. 
We have mava va. For B < Q, pva == mprava—=mg"va. Since va is invariant 
for (Xa, T) and (Xp, T) = 18° (Xa, T), by Lemma 12.2, rgva is invariant for 
(Xa, T). As a result, for each a we have a probability measure ye on X 
with wg(va) an invariant measure on Xp for al B >a. Let Pa denote the set 
of all probability measures on X with this property. We see easily that Pa 
is a compact set. Clearly PC Pa if a>’. It follows that there is a 
measure p€ N Pa. l 

We now claim that this measure » is invariant under T. To see this, — 
let Ba denote the algebra of functions on X of the form f*= where f € O (Xa). 
Since A is totally ordered, U Ba is an algebra. Since (X,T) is a limit of 
{(Xa T)}, it follows that U Ba separates points in X. It is therefore dense 
in C(X). For € Be, p =f", u(b) =rap(f). Since rap. is invariant under 
T, it follows that if rE T, ru(¢) =u($). Since this is the case for a dense 
subset of C (X), we conclude that p is invariant. This proves the proposition. 

Applying Propositions 12.1 and 12.2 and using transfinite induction we 
conclude that for any quasi-isometric flow there exists an invariant prob- 
ability measure. By Theorem 2.4, this will be true for any minimal distal 
flow. Since any flow has minimal components, the result is true for any distal 
flow. 

THEOREM 12.3. If (X,T) is a distal flow where T is arbitrary locally 
compact group, then there exists a probability measure on X, invariant 
under T. 


13. Order of a distal flow. In the definition of a quasi-isometric flow, 
there occurred an ordinal » corresponding to the “number” of successive 
isometric extension needed to.pass from the trivial flow to the given one. 
Clearly this ordinal is not unique. If X is the circle {|£|—1} and T is a 
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group of rotations of X, then m: XY—> X’ defined by »(£) —£? defines a sub- 
flow (X’,T) of (X,T). (XT) is an isometric extension of the trivial flow 
and (X,T) is an isometric extension of (X’,T), so that y could be taken as- 
1 or 2 (or any finite ordinal) for (X,T). Nevertheless, the least ordinal 
which could occur is well defined. 


Definition 13.1. Lf (X,T) is a q.i. flow, let 7 be the smallest ordinal 
such that we can write (X, T) = (Xp, T) where {(X& 7),éS7} is a quasi- 
isometric system (84). y is referred to as the order of (X,T). 

Proposition 13.1. Let (X,T) be a distal flow and (Z,T)=r(X,T) 
a subflow. There exists an isometric extension (Y,T) of (Z,T) which is a 
subflow of (X,T) such that tf (Y’,T) is any flow with these two properties, 
‘then (Y’,T) is a subflow of (Y,T). i 

Proof. Let {(Ya, T)}} range over the set of all flows which are subflows 
of (X,T) and isometric extensions of (Z,T). Set (Ya, T) a(X,T). 
For each a, there is a function p«(Yı,ys) defined on the fibres of Ya with 
respect to Z, and satisfying the conditions of Definitions 2.1 and 2.2. Set 
Ra(@1, 22) == pa (rai, mats) When rty = mt Ra(Tı, %2) satisfies: 


(a) Ba is a continuous function. 
(b) Ra(z,2s) defines a semi-metric on each fibre of X over Z 
(c) For g€ G, the Ellis group of (X,T), Ra(gti, 9272) = Ra(%1, 2) 


Lf X* == { (13, 23) : (21) =r (2:)} then X* is a compact metric space. 
In particular C(X*) is separable, and it follows that there exists a countable 
subset of {Ra} which is dense in the entire set. Let {Ra,} denote this count- 
able subset. Each Ra, is bounded, so for some sequence of positive terms {ca}, 
Xc, 2, converges uniformly. We set 
(13.1) R (2, T3) = X CyRa, (21, 73). 
R will again satisfy (a), (b), and (e) above. We now use the results of § 10. 
We define 2 ~ 2 if x(a.) =r (z1) and R(zı,2,) ==0, and let Y denote the 
set of equivalence classes. By what we have shown in §10, we may define a 
flow (Y, T) which is a subflow of (X, T) and an isometric extension of (Z, T). 
We claim that (Y, T) extends each (Ya, T). To show this it is necessary 
to show that if Ta~ Tr, then ra(Tı) = ra(T2) for each « But if ti~ Ts, 
then R(t, Ta) =0 and by (13.1), Ra, (zı 22) =0. Since {Re,} is dense in 
{Ra}, we find Re(21,2) = 0 for each œ. Since pa is a metric on the fibres 
of Fa, this can only happen if ra&, = ratz. This proves the proposition. 


Definition 13.2. Let (X,T) be a distal flow and (Z,T) a subflow. The 
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flow (Y,T) of Prop. 13.1 will be called the mazimal isometric extenston of 
(Z,T) in (Z,T). 

(F,T) is clearly unique up to isomorphism, so “this definition is un- 
ambiguous. 

Definition 13.3. A quasi-isometric system {(X,T),£=n} is said to be 
normal if each (Xg,T7) is the maximal isometric extension of (X,T) in 
(Xn T) where <y. 

Lemma 13.1. Let.4 flows be given as in the accompanying diagram 
where arrows indicate extensions. Suppose that w, © mı = W° m and that when- 
ever y and y’ are distinct points of Y, either mı (y) =m (y) or m (Y) r(Y). 
Then if (Z,,T) is an isometric extension of (W,T), (Y,T) will be an iso- 
metric extension of (Za T). 

(Y, T) 


Ti £ N ra 
(Z4 T) (ZT) 


Proof. Let p(2ı,7ı) be the metric on the fibres of Z, over W. Set 
oly, 4) = p(m (y), mı (y')) whenever mi(y) =m: (y). Since we then have 
wom(y) = W2me(y’) and wi(mi(y) =w(m(y’)), we see that o is well 
defined. o is clearly a semi-metric on the fibres of Y over Z,, and is invariant. 
under T. To show it is a metric we remark that if o(yı,y’) —=0 for m.(y) 
= m: (1), then we must also have m. (y) = m, (y), or y =y’. This completes 
the proof. 

THEOREM 13.2. If {(XgT),éS7} is a normal quast-tsometric system, 
then (Xn, T) has order y. 

Proof. Suppose {(X’s,7),éS7’} is another q.i. system terminating 
with (X„, T). We shall show that for each =n, (X’,T) is a subflow of 
(X& T). This is done by transfinite induction. Suppose (X's, T) = 6(X¢, T). 
Set (Xg, T)=r:(X,T), (Xg,T)=r#e(Xn,T). Let Y be the subset of 
X X Xs, of points of the form (wg(2),7’g1(2)) where ze X. There is a. 
flow (Y, T) which is then a subflow of (X, T) and we have r(Y, T) = (X¢,T), 
w (Y, T) — (X’g1,T). We then have the accompanying diagram. Since all. 

(F,T) 
tT Nw 
(ZT) (Zen T) 
N LF 
(Z'a T) 


the flows are the induced maps we have Oor—# 07. Also, by the definition 
of (Y, T) it is clear that m and =’ separate points in Y. We are therefore in & 
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position to use the foregoing lemma. Since # defines an isometric extension, 
x does so ag well. But then (Y,7) is a subfiow of (X¢,., T), the maximal iso- 
metric extension of (X,T) in (Xy, T). It follows that (X’g,,,T) is a subflow 
of (Xe, T). Let Q be the set of ordinals é for which (X’,T)< (Xa T). 
We have proven that €€ Q implies €+1¢€0. If é is a limit ordinal, then 
(X's, T) is the limit of { (Xn T), ¢ < £} and similarly for (Xg, T). It follows 
that if £€Q for ¿<é then €€9. Hence Q contains all ordinals Sy. So 
(Xn, T) < (Xn, T). But (X, T) = (Xy, T) so Y=n and this proves the 
theorem. ai 

To illustrate this result, let us take X to be the infinite torus, 
X = {£= (u, °°), | or | = 1}, and I, = mn (X), where m, assigns to 
each z, its first n components. Let T be the integer group and let (X,T) be 
generated by 


(13. 2) Ti (ĉr (CET CT 3 Fo (ett, £102," T'a Eman 5 *) . 
and (Xa T) by 
(13.3) T1( 01, En t bays * )— (etk, Cita + +, Saka). 
Here we take a to be an irrational multiple of m. Clearly (X, T)=m(X,T). 
Now consider the quasi-isometric system consisting of the (Xn, T) together 
with (X,T). If we can show that this is normal, it will follow that the order 
of (X,T) is the ordinal w. 

Lemma 13.2. The flow (Xa T) is minimal. 

Proof. See [6, Theorem 2.1]. 

Lemma 13.3. The flow (X,T) ts minimal. 


Proof. This is equivalent to the assertion that for each ze X, the set 
{mr %,—o<n<oo} is dense in X. By the foregoing lemma, the image of 
this set under mr is dense in Xa for each n. By the definition of the topology 
in X, it follows that {rı"z} is dense in X. 

Define a metric in X by setting 


(18. 4) d(x, 2) = max {2°" | ia —f, | 


where = (fn ta’ in ° +) and 2’ = (Cao 0s, Cm"). Note that if 
we consider X as a group with respect to pointwise multiplication, then this 
metric is invariant under group rotation. Using this metric, F (z, 2’) is defined 
as in § 5. 

LEMMA 13.4. Let a, 2/ be two points in X with mn(2) —= (2) for some 
n. There ewists a sequence of points {ry} with m (%) = Tn (2) = mpa (T) 
and F(z,2) > 0, F(a, 2’) 30, as ko. 
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Proof. Let 
T = (£1°,62°, ° t ty Emad, Ens Ems | -), 
A = (€1°,£°, az In, In Um Uns, Eo “) . 
We shall choose a, of the form (£1°, 39, © +, Sn-1°Cn6**, Gast Sasa’ °°), Where 
Bx is an irrational multiple of m and |&| <2* Then 
d(z,2) = 2 | es —1 | < 2-*#30 as ko. 

A fortiori, F(z,2)—0. We claim that we also have F(z,,0”)—0. More 
precisely, we shall show that F(z 2’) <a". 

Suppose that u = (én © in) and w = (Eau -,&s,° - °) are two 
points of X. Considering X as a group, we may form the quotient 
u/w = (&/€1,° - *,éx/&n). We notice that the quotient of the transforms 
ru and rw’ is a function of u/w: _ 

mini! (le EEr Ei bay? fen fin) =o (u/v’) 
where 
(18. 5) a (é, Éa TOT oTa bays . -) = (én STR = i ESAs a ENa 
It follows that 
F(u, w) = inf d (rı"u, rı"w ) = inf d(r1"u/r1"u’, 1) 


(13.6) = inf d(o”(u/u’), 1) 


where 1 denotes the identity element of the group X. We shall apply (13.6) 
to evaluate F (zr, 2’) 
We have‘ 


Wr = T/T — (1, pers 1, et», Ent /O m bnia/ Ë m2» area 
where e*8 occurs in the n-th position. Consider a general element of the form 


(13.7) w = (1,1,: + +, 1, es, rx, A, Às © *). 
then 
ow = (1,1,: - -,1, et», eff»), AWAg, Adds,’ °°) 
= (1,1,° + +, 1, P», NY NN" e) 


where the transformation (àr, Às, Asst © +) —> (Xo Aa Ast ) is that of 
(13.2) with «=f. Now apply Lemma 13.3. We find that the iterates 
{o™w,, —oo <m <% } are dense in the set of elements of the form (13.7). 
In particular these come arbitrarily close to the element 

$ =='(1,1,- > +, 1, 6t», 1,1,> > +) 


which differs from 1 only in the n-th entry. Then 
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inf ars < inf d(o"w,, w*) + d(w*,1) = d(w*,1) 
— 2% | etfs — J | < In, 


This proves that F(z, 7) <2-*, and our lemma is established. 


THEOREM 13.3. (Xn, T) is the maximal isometric extension of (Xa, T) 
in (X,T) and the order of (X,T) is v. 


Proof. Let (Y,T)=#’(X,T) be the maximal isometric extension of 
(Xna,Z) in (X,T). Then (X,,7)< (Y,T). If these two subflows are 
not identical, then there exist two points 2,2’ with m(2z) =,(7) but 
a’ (x) x(a’). Form the sequence {z+} in accordance with the preceding 
lemma. That is mı(4) =mı(2) =r (T) and F(z, u) > 0 F(a’, x) 0. 
Suppose p(¥1,42) is the metric for the fibres of Y over Xa; and set 
R (a, 2) p(#’2,,#’z,). Since the points zs and z are in the same fibre 
of X with respect to Xna, R(z, £4) is defined. Since R is invariant under T, 
R(x, £p) = R(r"2,1,"2,). Now F(x,2,)—>0 implies that for a sequence 
{mx}, d(r1" 2, 7:"*2,) > Oand so also (since R is continuons) R(r,"*z, r,"2,) 
—>0. Hence R(z,xx.)—>0. Similarly, R(7,2,)—0. But then R(z, 2’) 
S R(2,%) + R(T 2’) >0 and R(z,2’)—=0. This implies that #z— x's’ 

. contrary to our supposition. It follows that (Xj, T) is the maximal isométric 

extension of (Xn T) in (X,T). The second assertion of the theorem 
follows from the first according to Theorem 13.2. This completes the proof 
of this theorem. 
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SPACES WITH INVOLUTION AND BUNDLES OVER P*.*+ 
By J. LEVINE. 


In this paper we will present a general technique for studying fibre 
bundles over the real projective spaces P”. Our results will, in particular, 
enable us to give a complete description of the vector bundles over Pr for 
ng 4. / 

We begin, in part I, with a general classification theorem for bundles 
over P”. The analogy to the Feldbau Classification of bundles over spheres 
will be clear. But, as in the latter, this does not remove the difficulty of 
computations in particular cases. We are led to another problem. 

For any space with a base point and on involution which leaves the base 
point fixed, we will define equivariant homotopy sets—which will usually be 
groups. A calculation of these sets, in the case when they are not groups, 
is our new problem. In part II we develop some machinery for this purpose. 

In part III these techniques are applied to the study of vector bundles. 
We obtain the results mentioned above; these are summarized in 7.7. 

It might be worth mentioning that the theory of part II is developed 
primarily as a tool in the problem of classifying fibre bundles. We have not 
here considered its possible independent interest in the study of spaces with 
invoutions. This will be the subject of a future paper. 


Part I. 


1. Preliminaries. 1.1. Throughout Part I, @ will denote a compact 
Lie group with identity element e. We will denote a principal G-bundle by: 


8B = (B, P» x, @) 
where B is the total space, X the base space, p the projection and G the struc- 
tural group. We refer the reader to [6] for the necessary definitions. If 
B’ =a (B’, p, X’, G) 
is another principal G-bundle, a bundle map B —> B’ will be denoted by a 
pair of mappings (¢,¢) satisfying the following commutative diagram: 


* Received August 1, 1962. 

* This paper is essentially the major part of a doctoral dissertation presented to 
Princeton University, 1962. I am indebted to my adviser, N. E. Steenrod, for his assis- 
tance and encouragement. 
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B——PR 
p 
ZX— Y. 
Also see [6] for the definition. 


1.2. We will denote n-dimensional real projective space by P”, the unit 
n-sphere by S* and the closed unit n-disk by D”. Let 1: D”—> 8" be a homeo- 
morphism of D» onto the upper hemisphere so that i | $* is the inclusion: 
Let h: Dr Pr be the composition of + with the standard double covering 
S"-—>P», Let a: 8" 8” denote the antipodal map. 


1.3. A map f: S""—d@ called equivariant or an e-map if: 
fa(z) =f (£) for ze ga. 


A homotopy fi: 8”"2— G is called an equivariant homotopy (e-homotopy) if 
each f; is an e-map. An e-homotopy {fi}, OStS1, is a ce-homotopy from 
f to gif f=afıa* and g=—bf,b+ for some a,b E€ G. 


2. The classification theorem. 2.1. Let 8—=(B,p,P",G) be a G- 
bundle. Since Dr is contractible, there is a map H satisfying the following 
commutative diagram : 

B 


H p 


h 


D*— Pr. 


We define a map f: S**—> G by the following equation, using the right 
action of G on B: 


H (2) — Hyu(x)f (2) for ze gt, 


It is straightforward to check that f is equivariant; we call f the charac- 
teristic map of B associated with H. 


2.2. Proposition. Any two characteristic maps of B are ce-homotopic. 


Proof. Let f,f: S**-> G be characteristic maps of 3 associated with 
H,H’: DB. We define g: D”— G by: 


Hi (2) =H (2)g (2). 
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We can immediately verify: 


f(t) = gu(2)“*F()9 (2) for ze 8", 
Now define f: S**— G, for 0S!S1X, by: 


file) — g (tu(2))*f(2)g (#2). 
Clearly {fı} is a ce-homotopy from f to f’. 


2.3. From 2.2, it follows that consideration of the characteristic map 
associates to every G-bundle 8 a ce-homotopy class of maps 8**-—> G, which 
we shall denote by x(8). We now state the classification theorem. 


THEOREM. The correspondence x ts bijective. 
The proof of this theorem will occupy the next two sections. 


2.4. We first establish surjectivity. Let f: $""—@ be equivariant; 
we define a G-bundle B; = (By, pn P”, G) as follows. 


Consider the trivial G-bundle J = (D" X G, p, D”, Œ) and sub-bundle 
J’ om (9t X G, p', 8*41,@). Define a bundle map (M,a): J’> 7’ by: 


M (x,y) = (u(), f(£)y) for ce g7, y E G. 


Recall that „is the antipodal map. Since f is equivariant and « is an involu- 
tion, M is an involution. We now construct 8; by collapsing J under (M, p). 
More precisely, define B; to be D” X G collapsed under M and p; the pro- 
jection induced from p, i. e., so that the following diagram is commutative: 
HY’ 
D’XG——B, 


p Pr 
h 


D*———~—> Pr 

where H’ is the collapsing map. A right action of @ on B; is defined by 
demanding that H’ be a G-map. It is clear that G acts without fixed point 
and py collapses orbits. We can apply a theorem of Gleason [2] and conclude 
that 8, is a G-bundle. 

Define H: Dr>B, by H(z) =H’ (z,e); clearly p;H =h. It is a 
straightforward exercise to check that f is, indeed, the characteristic map of 
8, associated with H. Surjectivity follows immediately. 


2.5. We now verify injectivity. For 10,1, let B= (Bip, P”, G) 
be a G-bundle with characteristic map f; associated with H; Suppose f, and 
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fı are ce-homotopic; we will show B, and B, are equivalent. It clearly suffices 
to deal with two cases. 


(i) fo==a fia for some a€ G. 


(ii) fo and fı are e-homotopic. 


Case (i). We define an equivalence (E,1):8,—8,, when 1 is an 
identity map, by the equation: 


E(H,(z)y) =H, (a)ay for ze D”, y€ G. 


IE Hy(z)y—=H(2’)y and #7, then sé 8**, A straightforward 
calculation. shows that: i 


E(Ho(2)y) =E (Ho (2')y'). 


Therefore Æ is well-defined. It is easily checked that (F, 1) is a bundle map; 
this proves (i). 


Case (ii). By (i), we may assume 8, = Bs, as defined in 2.4. Let 
fi: S> G, 0S iS 1, be an e-homotopy from fe to f;. We will construct 
a bundle B — (B, p,I X P", G) such that 8B |(iX P*)— 8, for i=0,1. 
The construction is analogous to that in 2.4. 

Consider the trivial bundle F == (I X D* xX Q,p, IX D*,@) and sub- 
bundle = (I X 8** Gp”, IX 8", @). Define a bundle involution 
(M’,p’): J’ I’ by: 


W (t,2,y) = (t, p(z), fı(z)y) 
(4,2) — (t,u(z)) for tE I, sE Sri, yE G. 


We obtain 8 by collapsing J under (M’, p’). Proceeding as in 2.4, we 
verify that 8 is a G-bundle. It is obvious that 8 | (iX Pr)= B, for i=0,1. 
This completes the proof of the ciassification theorem.. 


2.6. Let z_i°(G) denote the e-homotopy classes of maps 8**—> G. 
We can define a group of wo(@) on mu.1°(G) by conjugation: If a€ G and 
f: S**—> @ is an e-map, consider the e-map afa!. If {a} is a path in G, 
then {a,fa;*} is an e-homotopy; thus the action is well-defined. 

In this framework, the ce-homotopy classes of e-maps S**—>G can be 
identified, in a natural manner, with the orbits of mn1°(@) under the action 


of m(@). This gives a more useful interpretation of the classification of 
G-bundles over Pr. 


18 
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Theorem 2.3 allows us to define an operation ©: if BE m4+°(@), let 
@(8) be the G-bundle such that x®(ß) is the orbit of £. 


We will make use of ® in part III. . 


Part II. 


3. Homotopy in spaces with an Involution. 3.1. In this section we 
initiate a study of the ma” (GŒ), introduced in 2.6. Since the only structure 
on G in which we are interested is inversion, it is useful to expand our con- 
siderations to any space X with involution 7. Thus we define z,°(X;T). 

If the space X has a base point z, fixed under T, we may define still 
more homotopy invariants of (X, £o T). Let T; be a reflection of S* about 
some 8%; the equivariant homotopy classes (.9*, 81) > (X,z,) form a group 
ift+>0. Ii—0 this gives the mm°(X;T') again; these are not groups, but 
there is a group action by (X). 


3.2. Let 8” and D* denote the unit sphere and closed unit disk in 
Euclidean (n+ 1)-space E*". The points of 8* will often be represented 
by pairs (z,y) or triples (z,¢,y) where ze Ek, te Et and yE Fr. 

Let 7,0 Sin, denote the reflection of Sr about the first i coordinates: 


T, (2,4) = (z, —y) it seH 


We agree to identify S** with the unit sphere on the first + coordinates 
in Er, Clearly, 8% is the fixed point set of T; Note that T, is the anti- 
podal map. . 

Let X be a connected space with an involution T. We assume X is 
n-simple for all n, i.e. the fundamental group acts trivially on all homotopy 
groups of X. Thus m„(X) is well-defined. Let 2) be a basepoint of X such 
that T (zo) =z; we say (X,2);T) is a space with involution. 


3.3. Let F,‘(X,2);T) denote the space of mappings f: (8*, S++) 
> (X, zo) satisfying fT; — Tf, with the compact-open topology. The constant 
map into To, which we also denote by zo, is a basepoint of Fat (X, zo; T). If 
t= 0, the base-point z, is unnecessary and we may, more generally, define 
Fu£(X;T). Sau 

The set of arc-components of F,4(X, zo; T) will be denoted by „X, £o; T). 
The arc-component of To, denoted also by To, is a base-point. If i—0, we 
may define m»°(X;T). Note that, if Z= G and T is inversion, m (X; T) 
= Tn’ (&), as in 2.6. l 
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In any discussion where (X, zo; T) is fixed, we will use the abbreviations 
F Pu and An. 


8.4. It will be convenient to have notation for the hemispheres and 
equators along different coordinate axes in 8”. Let D", D,r and Ir! 
respectively, denote the set of points (2,8,4) for ze Ht, where t>0, t=0 
and ¢==0, respectively. We identify 9°* with S** by means of the map 
e: 871 8" defined by: 

als, y) = (2,0, %) if se Et 
The following lemma will be useful. 


Lemma. If 0StSn—1 and f: D> X satisfies fa € Frat, then f 
extends uniquely to a map in Ft. 


Proof. We extend f over D,_* by: 
f | = TÍT, | Di. 


This is well-defined because T;(D,_*) — D,,% and is consistent on Ir 
because fac F,.*. Clearly ff7;—-Tf and f(S**) =T, since SH C mt. 
Uniqueness is obvious. 


3.5. It is clear that the involution: Tu, on S** may be regarded as the 
“suspension” of the involution T; on.8*. This fact may be expressed by a 
natural identification of Fat with the space of loops of F,* based at To. 

Let S(t), —1 & t < 1, denote the family of parallels along the (i -+ 1)-st 
axis in 9*** i.e. Sı” (t) is the set of points (z,t,y), where ze E*. Unless 
t= + 1, S(t) is an n-sphere; if = + 1, it is a point. In any case we 
Tepresent it as an n-sphere by the mapping ust: S*-—» 8"*! defined by: 


us (T, Y) == (02, t, oy) if se Bt, 


where c= (1—727)4& If fE Frau‘, it is easy to check that f; = furt E€ Fyt 
for —1 < t& 1. Clearly fı == fı =— z, since SP (+ 1)E€8t Thus {f;} is a 
loop in Fyt based at zo Conversely, if {f;} is a loop in F,* based at a, we 
can define FE Fait? by fut = fi for —1StSl. 

Thus every F,* is a loop space if i > 0 and, consequently, has a natural 
H-space structure. Suppose fı, fa € Put; define f: S*-—> X as follows: 


faldi, 2t—1, ey) if #= 0, 
. Babe) | fale’, ttl, y) if tS0, 
where ze Et, y—2(t/(1 -+ t) jt, e”;==2(t/(t—1))&. This is well-defined 
when ¢=0 because f,(0,— 1,0) —f,./0,1,0) = zo. It is straightforward to 


522 J. LEVINE. 


check that f€ F,*. In the H-space multiplication inherited from loop multi- 
plication, f is the product of fı and fe. 

Finally, we can conclude that, for i > 0, the z,* inherit a group structure. 
If 10, there is no analogous structure. 


3:6. Remark. Let A be a topological space with base point ad. Let 
QA be the loop space of A based at a, and T the involution of NA defined 
by reversing the orientation of loops. Let s*P* denote the t-fold reduced 
suspension of real projective k-space. Then there is a natural homeomorphism 
between #',4(QA,a);¢) and the space of mappings (stP-"1, r) > (A, ao), 
where a is a base point of P*-**, If1t>0, “track multiplication” is defined 
on this space and corresponds to the multiplication in F,*(QA,a.;T). 

If A = Bg the classifying space of the group G, this means that G-bundles 
over P” are classified by mpn? (QBa; T) after an appropriate collapsing under 
action of ro (2Ba) ~7:(Be). This is closely related to the results of Part I. 


3.7. There is another algebraic structure on the m+(X,2,7) for all 
420. We will show that mn =m,(X) is a group of operators on the mt. 
First we derive a standard lemma. 


Lemma. Suppose X is an n-simple space. and fofi: ">X are 
homotopic. Furthermore, let gi: D, %—>X, 0StS1, be a homotopy of 
Jo = fo | Di to gı = fı | Di". Then {g:} extends to a homotopy of fo to fa. 


Proof. It suffices to prove the following statement. 


(*) Suppose MCL CK are subcomplexes and complexes and M is a 
deformation retract of L. Let f: L>X, for any space X. If f | M is 
extendible over K, so is f. 

To see that the lemme follows from (*), let y € D,- and set K = I 98°, 
L=(1 XD") U (£X 8") and M= (Ixy) U (LX Sr). Define f by: 


fı(z) if tEI,ze Sr. 
Kee) ee if te l,ce Dy. 


Now f| M is extendible over K because f, is homctopic to f, and X is 
n-simple. That f is extendible over K is the conclusion of the lemma. 


Proof of (*). Let rz: L>L be a homotopy such that »,— identity, 
r,(L) =M andr; | M is the inclusion, for 0<t<1. Since f | M is extendible 
over K, so is fr, But then, by the homotopy extension theorem, f fr, is 
extendible over K. This proves (*) and, therefore, the lemma. 
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3.8. Let acer, 8 ut and define Ti: 8" 8" to be the reflection along 
the (¢-+1)-st axis, i.e. 
ri(a, $, y) — (x,—t,y) if ze Et, 
Choose representatives fo: 8" X and go € F,t of œ and A respectively, so that: 
Gort | D,” = fo | Dy. 

By 3.4, we may extend fo | Dy." to ho € Fat, because foes == Joe € Feat. Let 
yEru'! be the homotopy class of ho; we shall show that y depends only on 
a and £. 


Let fı: O*—>X and g€ F,* be any other representatives of a and £, 
respectively, such that: 


gari | Du = fi | Di. 
Then we can define h, € Fy‘, as above. Let {ge} € Fat be a homotopy from 
go to gi. By 3.7% there is a homotopy {f:} from fo to fı such that: 
giri | Di = fi | Di” for OStS1. 
Then, from f; and g, we can construct h€ Fat for 0<t<1. It is clear that 


{ht} is a homotopy in Fy* from ho to h; thus h, also represents y. 
We denote the element y by œ- B. 


3.9. We now show that the operation (a,8)—>«a-f defines a group 
action of ma on au‘. Suppose a, and a,€ m, and BE m, are represented by 
fufa: S*>X and ge Fat, respectively, such that: 


fa | Dp *— gri | Di 
fa | Di = fari | Di. 
Then &,'& is represented by f: 8”— X defined by: 
f | Di =f | D," 
f | Da-" = fi | Di,-* = gr; | Di 
and a,‘ ß is represented by he F,* defined by: 
h | Di" = fa | Di" 
and 8.4. It then follows that: 
hr; | D; = fet; | Dy" = fy | Dy", 


Now, it is straightforward to check that a,’ (a8) and (a,+a,)-B are 
both represented by h’€ F,* defined by: 


W | Dy — fi | Daa 
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and 3.4. This proves that («@-8)—->a- is a group action. 
4. An exact sequence. 


4.1. Let (X,2,;7) be a space with involution. We define: 


Qi : Th — rn? 
u : Tnt => Tra! 
pi: Tnt > Ty. 


The main result of this section (4.8) will be an exact sequence involving 
these functions, 

Let BE m,‘ be represented by ge Ft and let «em. Then g(a) 
== &*2o,¥i(8) is represented by geacF,. and m(ß) is represented by g: 
SZ. 


4.2. Iit>0, dy yı and pı are homomorphisms. That p; is a homo- 
morphism follows from the fact that the H-space structure of F,*, as defined 
in 3.5, agrees with the group structure of m. The function % is a homo- 
morphism because multiplication is along the i-th coordinate axis while y is 
defined by restricting mappings to the equator along the (+-+-1)-st coordi- 
nate axis. 

That ¢, is a homomorphism follows from the more general formula, 
for t>0: 

(a1: aa) + (Bı° Be) = (41°81) > (2° Ba) if a; € ma, By € amt. 


This formula follows from the fact that multiplication is defined along the 
ith coordinate axis while the group action is defined along the (¢-+1)-st 
coordinate axis. 

From the formula it follows that, if +> 0, a: 8 = q¢;(&): 8. Thus, the 
group action of ma on wp‘ is determined by the group structure on za‘ and dy, 
ift>0. Only if += 0 is the group action significant. 


4.3. Tunorem. The following sequence is exact: 


Piri pi y pi 
+ n ——> Tmn —— T — nt — na i 
pı Po Yo Po 


a tt a I a TI Tnt 
where exactness at the right end of the sequence ts defined by: 


(a) Image pı == $01 (2p). 
(b) yo2(8) ts an orbit of the action of mas On mp4? for BE man". 
(c) Image o= ker po. 
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Remarks. (1) If T has no fixed point, ma? is still defined together with 
the group action of a, on rn? and the functions y and po. In this case, (b) 
and (c) are still valid. ; 

(2) Suppose, as in 3.6, that XY —OA, where A is a space with base 
point a, and To is the constant loop at a. Let f: St>P* be the double 
covering; in [5], Puppe associates with the map f and space A, an exact 
sequence: 

-e= n (SPR, A) > r (st, A) > r (sth A) 
— 1 (stPk, A) Dal, A) >: - - 
» +> (8P*, A) > 1 (s8*, A) > (Cy, A) > r (Pt, A) > (8%, A) 


where m (B,, B2) is the set of homotopy classes of base-preserving maps Bı —> B, 
and O; is the “mapping cone” of f. It is easy to check that Cy is homeo- 
morphic to P*!, Using the remark of 3.6, one can show that the exact 
sequence of Puppe coincides with that of the theorem. 


4.4. Proof of Theorem. It clearly suffices to prove the following state- 
ments for all i= 0: 


(a) Image pis = si’ (T0). 
(b) yr? (B> is an orbit of the action of an On mnt for BE npt. 
(c) Image p= ker pi 


The proof of these statements will occupy the next three sections. 


4.5. We first prove (a) of 4.4. Let g’e F,#*' represent BE r,t; we 
will show gip (8) =2o. Let {g':} € Fast be the loop defined by g's = gust, 
as in 3.5, for —1 S t< 1. Reparametrize this loop by any map w: (D+, 8°) 
—> (D!, 8°) such that: 


—1 if #0, 
w(t) = | 1 if tml, 


This detines a loop {g:}, where g: = g’ou,, and corresponding g E Fatt, defined 
by gtt = g; Any homotopy of w to the identity, modulo 8°, induces a homo- 
topy between g and g’ in F,#!. Therefore g represents @ and, clearly, 
g( Di") = To. 

Now ¢ipii(8) is represented by the extension of g | D,,” to an element 
of F,*. To show gip (8) = 2%, by 3.4 it suffices to construct a homotopy 
hg: Di. > X, OSs S1, satisfying: 


hs =g | Di 
hy = Zo 
hae € Frat isss. 
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Note that g | D,,” corresponds to the path in F„.* given by {g:} for 
0=:=1. For each s between: 0 and 1, we consider the path in F„,* defined 
by cutting {g:} down to the interval sSt=1. More precisely define 
hss € Pat by: 

hat = Jor (1-0) 
Then we define h, by: 
haut = har 


It is easy to check that {h,} is the desired homotopy since kse; = hy o 
= e € Part. 


4.6. To complete the proof of (a), we must show that, if «€ r,t and 
la) = zo then a€ Imagepy,. Let f: (8%, D") —> (X,z,) represent a. 
That &(@) =a) means there is a homotopy fi: Dy” >X, 0S¢S1, such 
that: ° 

fo=f | Diy” 
hen 
Fe € Fait. 
Now define ge F,** by: A 
: . if 0O<t< 
gi‘ == pa ? o 


It is not hard to use the homotopy {f;} to construct a homotopy between f and 
g, stationary on Dy”. Therefore «€ Image py. 


4.7. We prove (b) of 4.4. It is clear that y;(a' 8) —=,(8), for any 
GE a, BE nt, since, in the construction of 3.8, the representative map of 
a: coincides with that of 8 on Ir. 

Suppose fy, a€ mut and yalı) =yi(Bs). Let gE Fat represent £j; 
then gı& is homotopic to gae in Fy.*. By the homotopy extension theorem 
and 3.4, g, is homotopic in Fu? to g’, satisfying g'i = ga. Define f: >X 
by: 7 

f | Di = 92 | Dy. 
Af | Dut = g'ir | Di”. 


We may check, using 3.8, that a: ß, == ß,, if f represents a. This completes 
the proof of (b). 
To prove (ce), we merely note that 8€ Ker p if and only if a represen- 
tative of ß is extendible over Dr. By 3.4, this is equivalent to 8€ Image y 
This completes the proof of 4.4, and, therefore, 4.3. 
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4.8. We conclude this section with two useful results incorporated in 
the following proposition. T, will denote the involution of z, induced by T. 


PROPOSITION. (a) If a€ a, BE rat, then: 


ala B) == p(B) + a+ (1) T (a). 
(b) The homomorphism pn: mn > mm" is an isomorphism. 
Proof. To prove (a), let f: S*— X represent a and ge Fat represent £, 


eng, 
andre assume: 
aL) o f| Dit = gri | Di. 


‘Then, by 3.8, æ- B is represented by A€ F’,', where: 
x 
(2) h | Dy" =f | D,. 


From (1) and (2) it is easy to derive the following: 
h | Dia” = f | Dy 
f | Da- = grs | Ds" 
g | D,” = Tr) | Di, 
TÍT, | D,” =h | D,” 
It follows from these that, in zp, the element represented by h is the sum of 
the elements represented by f, g and TfT, Since deg T;,—= (—1)**, this 
proves (a). 
To prove (b) we notice that, by 3.4, r„" is the set of homotopy classes 
of maps (D,,", 8) > (X, £o) and ¢, is the natural isomorphism with ry- 
5. Stability and double coverings. 


5.1. We will first derive a theorem (5.2) relating the mnt of a space 
with involution and an invariant subspace under connectivity assumptions on 
the pair. We then study the x,‘ of a double covering of a space with involu- 
tion (5.6). ° 

For j = 1, 2 let (X,2,;T,) be a space with involution (see 3.2). Suppose 
f: (Xat) > (Xe, £2) satisfies fT, = Taf. Then we define: 

fe: wat (Xa, 21571) > aa! (Xo, T25 Ta) 


in the natural manner. It is straightforward to check that te preserves the 
group action of 3.8 in the sense of: 


(fet) (FB) = fala B) if a€ m(X1), BE mt (Xi), 


and fa commutes with the functions of 4.1. 
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5.2. We will prove the following “stability” theorem. 


THEOREM. Suppose (X,2,;T) is a space with involution and A is a 
subspace of X containing T, and invariant under T such that (A, £o; T) is a 
space with involution. Let i: AX be the inclusion and suppose (X,A) is 
k-connected. Then the induced function: 


mA; T) > wal (X, 20; TL) 


(a) ts onto tf kn. 
(b) is one-one if k= n-i. 


Proof. It suffices to prove the following statement: 


(*) Let K be an n-complex with subcomplex L and X a space with 
subspace A. Suppose the finite group ~ acts on K (simplicially) and on X 
so that L and A are invariant. Suppose, in addition, that (X,A) is n- 
connected and r acts freely on K-L. Then any -equivariant map f: (K, LZ) 
— (X,A) can be wr-equivariantly deformed, modulo L, into A. 


5.8. To see that the theorem follows from (*) we proceed as follows. 
Recall that T, acts freely on 8*—-8*1.. To prove (a), let K = 8", L= St 
and r= Z, generated by Ti. f 

To prove (b), we apply (*) to a more complicated situation. Let 
K =I X 8", L= (I X 8+) U (Å X 8") and m= Z, generated by the involu- 
tion (t,x) > (t, T;(x)); then (*) shows that any homotopy in Fẹ (X, z; T) 
between two maps in F„t(4A, 2o; T) can be compressed into Fp (A, £o; T). 

The proof of (*) is quite standard. We construct the deformation 
skeleton by skeleton, using the n-connectedness of (X, 4) to solve the exten- 
sion problems and the free action on K-L to maintain r-equivariance. We 
omit further details. 


5.4. Let (X,2,;T) be a space with involution and p: (F, yo) > (X, 2) 
a double-covering with covering transformation t: YY. Suppose we 
assume the condition : 


(t) Typem(F)C pyri (Y) 
i.e. the subgroup of m(X) corresponding to the covering p is invariant 
under Ty. 


PROPOSITION. There are precisely two involutions of Y-denoted by T” 
and T’—covering T (pT ==pT” ==Tp). Moreover TT” — T”T' =t; in 
particular exactly one leaves yo fixed. 
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Proof. This follows by elementary covering space arguments. By 
[3, p- 90], there are unique maps fj: Y > Y for j=1,2, satisfying: 


Ph Tp, falyo) = Yo fa(Yo) = t(Y0). 
Now notice that f} —f;f; satisfies: 


pipmp, fF (Yo) =Y; 


therefore f; ==identity and f; is an involution, by [8, p. 90]. Now, if 
f=t, fifa or fef:, then: 


pf=p, f(y) =t(¥o)- 


Therefore, by [8, p. 90], these are equal. The proposition follows by setting 
fiı= T, f= T”. 
Notation. Let T” be that involution of Y covering T satisfying T” (yo) 


=Y, Let T denote either T’ or T”. 
Note that (F, y0; T”) is a space with involution. 


5.5. The covering map p induces functions: 


PH: an (Y, Yo; T) > ma (X, T; T) if i21, 
PE: ae (Y, T) > m (X;T). 


In the spirit of homotopy theory, we may say a great deal about pẹ. 


Propostrion. A. (i) If +21, pp is a monomorphism. 
(ii) If +22, ppa is an epimorphism. 
B. (i) If i—0, p4(B) =p (£) if and only if B—p’ 
or B — ty (8). , 
(ii) If i—0 and n= 2, m? (X; T) is the umon of 
the images under pg of ma? (Y; T’) andas? (Y; TY). 


Proof. We first prove A-(ii) and B-(ii). Let fe F,„t(X, zo; T), where 
n=? and #541. Since Sr is simply-connected and S** is connected, 
[3, p. 89] says that there is a map g: (S*, S**) > (Y,y,) such that pg == f. 
If i> 0, 8+ is non-empty and [3, p. 89] says g is unique. But 7’gT, is 
such a map also; therefore g € Fa* (Y, Yo; T) and A-(ii) is proven. If i= 0, 
[8, p. 89] says there are exactly two mappings with the properties of g. But 
T’gT,>£T”gT,; therefore ge F,°(Y,T) for some T, and B-(ii) is proven. 

We now prove A-(i) and B-(i). Let go, 91 € Fat (Y, Y0; T), where T == T” 
ifi>0. Suppose there is a homotopy {ft} € Frr(X,2,;7) between fo = pg, 
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and fi=—pg1. By [8, p. 89], there is a unique homotopy g’;: (8, 8**) 
> (Y, yo) with go go. -But {7g’:T,} is also such a homotopy; therefore 
(P) EPa (F yT). Now pg’s—pg, and (I) —g(9). It i>0, 
[3, p. 89] says g'i = g1; if t= 0, g'i = gı or tg,. This completes the proof. 


Part III. 
6. The orthogonal group. 


6.1. The remainder of the paper will be devoted to calculating 
Tna? (X; T) where X is a component of the orthogonal group and T matrix 
inversion. By 2.6, the operation ® converts this into a classification of vector 
bundles over P*. Complete computations will be made for n= 4. 

In this section we will study certain structure induced on the m° (X; T) 
by ©. 


6.2. Let O, denote the orthogonal group on k variables. We denote 
by Rz and A+, the two components of Or, consisting of rotations and reflections, 
respectively; X, will denote either of the components. Matrix inversion, 
denoted by T, induces on involution of X+. It is clear that ma’ (Ox), in the 
notation of 2.6, is the union of the m° (Xx; T). We shall write =,°(X;) 
=a! (Xr To; T). Ä 

Since the orientable k-plane bundles are those with group Rx, ©(m,.1°(Rx)) 
are the orientable bundles and, consequently, © (m.,°(Ax)) are the non-orient- 
able bundles. 


6.3. Let a€ mn’ (Xr), Ben (Xm) be represented by fe F,(X,) and 
gE Fa? (Xm), respectively. Consider h €E Fa? (Xrm), defined by: 


al ge) 


If h represents y€ mn? (Xym), We write y=a®ß. This gives an asso- 
ciative and commutative pairing. 


PROPOSITION. @(« ® 8) is the Whiiney sum of ®(a) and @(£). 


Proof. This is a direct consequence of the definition of Whitney sum 
as follows. If two bundles are given by coordinate neighborhoods indexed by 
a set J and coordinate transformations {g’y | i, j € I} and {9 | 3,7 € I}, their 
Whitney sum is given by coordinate transformations {gy | 1,7 € I} where: 


s(a) 
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Let em denote the identity matrix in Om; as in 3.3, &„ also denotes 
elements of F,'(Rm3é@m) and amt (Bm €n). If i: Or—> Orm is the natural 
inclusion, then: 


ty: an (Xz) > tn? (Xrm) 
is defined and, it is easy to see, ip(a) =a @ em, for a€ Ta? (Xz). 


6.4. We now discuss Stiefel-Whitney classes ([4]). Let L,[wu] be the 
polynomial ring over Z; on the indeterminant u and truncated by un? — 0, 
The Stiefel-Whitney class of a k-plane bundle over P™1 can be considered 
an element of L,[u] if u is identified with the generator of H*(Pr;27,). 
We define: 


W: rn? (X) > Ly [u] 
by W (a) — Stiefel-Whitney class of @(a). 


The following propositions are restatements of well-known facts in our 
terminology. l 


Proposition 1. The following diagram is commutative: 


Yo 
an’ (X) ———> mr? (Xz) 
wW W 
y 
Lalu] ——> L,.[u] 
where y is the reduction um! —0. 
Proposition 2. If a€ mn? (Kr), BE au (Xu), then 
W(a@B)—W(a)-W(f) in L,[u]. 


Proposition 1 is obvious if we notice that Yo corresponds, under ®, to the 
restriction of bundles over Pr*! to Pr, Proposition 2 is the Whitney product 
theorem. 


6.5. Let fe F,°(O,). If we define g by: 
g(x) == (—ex) fe) =f (2) (— er) 


using matrix multiplication, clearly ge F,°(O,). Thus fg defines an 
involution I of 2,°(O,). 


PROPOSITION. If k is odd, I induces. a: one-one correspondence between 
Ta? (Rx) and wr (A;). 


582 J. LEVINE. 


_ Proof. If k is odd, —6,€ A, and I interchanges the components of Ox. 
6.6. The following “stability” theorem follows directly from 


5.2. Tueorem. Leti: Or—> On. be the natural inclusion and a € X 
any element satisfying @—&. Then: 


tg: amt (Xu, 0) > amt (Xa, a) 


(a) is onto fkzn-+l. 

(b) is one-one if kZ n432. , 

6.7. If k= 1, let a, denote the element — ex in Or If m=k, let: 
a; denote the element i(— ex) in Om, where i is the natural inclusion Og C Om: 
As in 3.8, a, also denotes elements of Fat(Xm,@x) and an! (Xm, a), since 
Ay? = bm. 

Let L be the non-trivial line bundle over Pr*!, 

Proposition. Let Gy E mn? (Xm); then ®(a,) is the Whitney sum of k 
copies of L and a trivial bundle and ®(em) is the trivial bundle. Conse- 
quently, W (em) =1 and W (ar) = (1+ u) 

Proof. If k=m=1, Rn {a} and Am {a} and the proposition is 


obvious. For m = k= 1, the proposition follows from 6.3 and 6.4 if we 
observe l 


xm, D Du Ba: De 

and em = 6 O'O e 
where we have m components in each decomposition and k copies of a. 

7. Computations. 

7.1. We will now compute the m° (X+) for n<3. If S is a set, we 
write: 

S= {C,,C3,° . Op . ‘} 

to indicate that 8 is composed of the distinct elements Cn Cat © -,C,,- °° 


In presenting our results we will use the notation of the group action intro- 
duced in 3.8. We will also need to fix notation for elements of 7,(X;:). 


(a) (A) =Z generated by A 

(b) ma(R:) =Z generated by oo. 

(c) we(R,) =Z +Z generated by o, and oz. 
(d) ms(Rı) =Z generated by o, for k Z= 5. 
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In addition, under the inclusion Rẹ C Rs, op 01; under Ry C Ry o2->0 
and o,-»>—2c. We refer the reader to [6] for proofs and more detail. 
In all cases, if «€ m, (Rx), then a will denote the translate of « into m_(Ax). 


A. 1. aa? (Be) = {€2, do} for n21. 
2. (a) m (As) = {(ne) a, | nE Z} 
(b) mn’ (As) = {a} for n= 2. 


3. Action of m,(0,) is trivial except on r? (42) 
where (ne) -a,—> (— ne) a. 


B. 1. an? (Re) = (6x, G2} for k Z2, n—1,2. 
© R. an? (Ay) = {01,0} for k= 3, n=1,2. 
3. Action of mo(Oz) is trivial. 
C. 1 a) ara (Rs) = {és, lay Co ' ao} 


( 

(b) ma? (Ra) == {64, Qa, O1 ° Oa; O2 (a, (o1 +02) * a, as} 

(c) ms? (Ryg) = {6x Ao, 0 ` Be, a4} for k Z5. 
and o'd = ls if k= 6. 


2. (a) ma? (As) = {t da, 09‘ t} 
(b) ma? (4a) = { (10a) ` da, (0'2) dy | n€ Z} 
(c) m? (Ap) = (m, dp, 0’ * Gg, Qs} for k Z5. 
and o’: as = ay if k=. 


3. Action of wo(O;,) is trivial except on rs? (R4) where 
02'023 (o, +03) ‘a, and on r? (4,) where 
(no’s) a —> (—MNo’s) + dy. 


There are many more details which may be easily deduced from the proofs to 
be presented e.g. the Stiefel-Whitney and Euler classes and the effect of the 
natural inclusions Ox C Ox. In 7.7, we present a restatement of our results 
after applying ©, i.e. in the language of vector bundles. 

Tt is also quite easy to calculate ma? (Xy) for n= 7, in the stable range 
k= n +2, but these are already known (see [1]). 


7.2. We introduce a notational convention. Because of the ambiguity 
in our notation for the functions &, y4 and p, we may be led to discussing, 
in the same context, more than one of these functions with the same name. 
In this case we will write one as gy, y4 or ji to differentiate them. 


Proof of A. Let a€ X, such that a?= e Consider the following 
diagram : 


534 E en 
ae Se) Euer. AB 
pı do 
m (Zz) = mo(X3) 





By 4.3, the row is exact; by (4.8-b), $o and ¢, are isomorphi 
exactness tells us dy) is onto i.e. m? (X2) is ee the orbit of a. ae } 
action of mı(X;). 2 ee os 

‚Since matrix inversion is of degree-—1 on R, and the identity on! Bi 
` we have, from (4. 8-a) : ee 

0 if a€ mı (4e), 
prpi (a) = foa if ac ey 


this proves 2(a). If X,=R,, it shows m,’ (Re) consists, of 
but W (e:) W (a2), by 6.7. This verifies 1 for n—1. 


Now consider the following exact sequence: 


Since $, is an isomorphism, this determines Image pi. ‚Bi reoxagtiess,: 
j ar o RA 3 ane 


—- 


$ 
an(X2) — om (X, a) Peak Tn? (Xe) on Tra gor + 


Note that po (ez) = po (ax) =0. Let n= 2; then if a € mı (4A: )> An a, rem 2 
by (4.8-a). It then follows that: 


{oa} if X= Ry 


Imagoyo — Korpo — | a) it Xam As 


Since 7,(X,) = 0, yo is a monomorphism and 1 and 2 follow for n—?2. If 
n = 3, a(X2) = Tmn (X3) — 0 and yo is an isomorphism; then 1 and 2 follow 
for n= 3. 


To verify 3, we use the following two easily verified facts. . 


(i) a0(Om) acts trivially on Em and ax, for k<m. 


(ii) I£ aE r,(Xs), BEm’(X,) and the action of m,(0;) gives > Boy 
B— Bo, then «-B— a‘ Bo. 






Since all the elements in the 7,°(Xx) which williby: 
the form &'emn OT @:d,, statement 3 of A, Band C fgilows 
and (ii) and knowledge of the action of (Ox) on Mr). -. 


je 


paris, UL ye eu 
i rectly aa 


. SPAOES WITH INVOLUTION. 535 


For n= 1, consider the following diagram for k>.3, with exact row: 


$o Yo 
ar (Xr) ——> m (Xr) — m (Xx) 
fo 
(Xx) 


Since ġo is an isomorphism by (4. 8-b) and m. (Xi) S Za 7i(Xx) consists 
of at most two elements. But w(ee) w (ai) and w(a,) ZI = 6.7; 
this verifies B for n=1. 


7.3. Proof of B. For n= -2 consider the following Sa sequence for 
k23: 
o Wo Po 
te (Xx) — ma? (Xz, a) — m? (Xx) ——— r (Xz). 
We have just seen that m° (Xx) consists of “constant” elements; therefore 
pom 0. Since ma(Xz) = 0, yo is an isomorphism and B is proved. 


7.4. Proof of ©. To prove 1(a) consider the following exact sequence : 


Pı 0 Yo. oo o 
Tg? (Rs, a) en (Ra) —— Tg? (Rs, a) ——— ae? (Bs) —7 (Rs) . 


Since m? (Rs) consists of “constants,” po==0; by exactness, ms? (Rs) consists 
on the orbits of es and as. By (4.8-8), pi(a-a) == 2a for aem(h,), a = eg 
or @s; thus the orbit of a is a and o):a. To complete the proof of 1(a) we 
must iow 


(i) lg == O9 ' Êg. 

(ii) Qe 56 Oo ` Az. 
Proof of (i). By exactness, we must show oo€ Image p, for a=e, in 
the above sequence. Now, according to [6], p is represented by the following 
map f: S*—>,. Identify 9° with the unit quaternions, where the first 


coordinate is the reals, and R, with the rotations of the purely imaginary 
quaternions. Then f is defined by: 


f(q)-¢= 974 


where q, g’ arè unit quaternions and @ is the conjugate and inverse of q. 
Since T,(q)—=q@ and S°—{+1}, it is straightforward to check that 
fE F (Rae). But this means op € Imagep:, which proves (i). 


14 
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Proof of (ii). Consider the following diagram with exact row: 


0, po 
ma? (Ri) ——> m? (Ra) —> m (Ra) 
Bo 
za (Ba) 


Suppose &=o0,'; then m (R) = {e,a,} and po=0. By exactness, 


m,’ (Rs) consists of the orbits of e, and as It is then easy to see from 
(4. 8-a) that po = 0, since m, (R) =Z. We will contradict this by exhibiting 
an essential map g: S+—> Rs such that g € F3? (Rs). 

Let h: $®— 8? be the Hopf map which collapses great circles; in 
particular AT,—=h. Let h’: S'— S° be the suspension of h along the first 
coordinate ; because it is a suspension, A’ (TTo) = (T.Tı)h. From hT, =h, 
it follows that A’T,—Nh’, since T, is the suspension of To. By composing 
with To, we have: 

(*) WT = ToT ih’ 


Now recall the map f from the proof fo (i); it is easy to check that fT, =f. 
By applying this to (*) we have: 

(fk) To = fT =T (fh’). 
Thus fh E€ F(R,); but, according to [6], fh’ is an essential map. This 
proves (ii) and, thus, 1(a). 


7.5. To prove 1(b), we will study the covering p: 8: X S'oR,. If 
we identify S* with the unit quarternions, as in 7.4 and R, with the rotations 
of the unit quaternions: 


P(9 92) 919199 For q, qu, q2 E DP. 
The covering transformation 1: S* X S*— 8° X 8? is defined by: 
(qi q2) =(—Gu— 2) For qi, qa E S°. 


We can apply the theory of 5.4 and 5.5. It is easy to check that the involu- 
tions T” and T” covering T are defined by: 


T (91, 9) = (91, Ge) 
T” (qi, q2) pa (— is => ĝa) for 91 qa € 88, 


Let 7 denote either 7’ or T” and let X = 8? X 8°. 
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Lemma 1. If b ts a fixed point of T and a, a, generate m,(X), 
wa? (X ; T) = (b, a, b, azb, (a, + aa): b} 


Proof. Since X is 2-connected, it follows easily from 4.3 and (4. 8-b) 
that: 


(t) mat (X, b; T) = {b} if iSnS2. 


Now consider the following diagram with exact row and column: 


m3(X) 
hı 
Pi bo 7 0 = 
as: (X, b; T) —m(X) —om(X,b;T) —m’(X;T) 
yi 
m (X, b; T). 


From (ft), ¢: and œo are onto; by (4.8-a), pidi(a) = 2a. The lemma 
follows immediately. 

Let b’, b” € X be fixed points of 7’, T”, respectively, so that p(b’) == by 
and p(b”) —=a,. Choose a, a so that p,(aj) =o; Let t be the covering 
transformation defined above. 


Lemma 2. (i) t(D) =% b; (ii) t (b) =b”. 
Proof. (i) Since py(a,-b’) =c: e, and pa(b') == e, it suffices, by 


(5.5 B-(i)), since a,-b’4b’ by Lemma 1, to show o,:e¢,==¢, But this 
follows from (i) of 7.4 under the inclusion Rs C Ry. 


(ii) The fixed point set of T” is homeomorphic to S? X S?; in particular, 
it is connected. A path in this set between b” and £(b”) defines a homotopy 
of constant maps in F',9(X;7’) which proves (ii). 

Since ¢, on m,(X) is the identity, Lemmas 1 and 2 and the formula of 
5.1 describe ty completely. Together with (5.5-B) this implies: 

m? (R4) == {€4, O2 85,03, 01° lay O2 * Oo, (o + 02) te). 


To complete the proof of 1(b) we have to show o,'e,== a, Consider the 
following exact sequence: 


0 Yo 
Tg (R,) =S— > Tg? (Ba, e4) =>. Tal (Rs) . 


By definition, 02+, = $o(02) ; therefore Wo(o2- e4) = e, and, by 6.4, YW (oa> es) 
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=]. Similarly yW(a-a,)—-1+u*, for any a€ r,(R4). But yW (a) 
— y (1 4 ut) = 1; since W(e,) = W (a4), this shows a, —=o;' e4 

To prove 1(c) we merely apply 6.6 and 7.1 to 1(b) and note that 


T3? (Rx) has at least four distinct elements, since W (ex), W (a2), W (a4) and 
W (ao) are distinct. 


7.6. We now prove 2 of C. In fact, (a) and son follow from 1(a) and 
(c) and 6.5. It remains only to prove (b). 


Consider the following diagram with exact row where a= @ OT dy: 


pı o Yo ` 

T (Ana) mr (As) — m (Au, 0) —> 7 (414) 
po 
ms (44). 


By (B,2), yo is onto and m° (44) consists of the orbits of a; and ay. Clearly 
2(b) will follow from the following two statements. 


i 
| 


(i) a'€ Image p, for a — a, and as. 
(i) popo(o'2) 0 for a—a, and a. 
Proof of (i). IE ac A, define fa: 8° A, by: 


folg) =a-f(q) For geS®, 


where f is defined m 7.4. Ifa=a, or — a, fa €F (44, a) since a,(q¢) =— G 
and (—a)(q) = 9. For a= a, this proves (i). Let A be a rotation which 
satisfies Ay AT —a,; e.g. a cyclic permutation of the first,.third and 
fourth coordinates. Now define g: S°'— A, by g—4A"f,4, where a—==— a. 
It is easy to check that ge Fs! (As äs), which proves (i) for a. 


Proof of (ii). Since Ty(o’2) o's, it follows from -(4.8-a) that 
poo (o's) -= 20’2. 
This completes the proof of C. 


%.7. We conclude this work with a tabulation of the results of 7.1 in 
terms of vector bundles over P”. T and L denote the trivial and non-trivial 
line bundles, resp., and summation is Whitney sum. The {4,}, {B,} and {C;} 
are infinite families of vector bundles; the subscript 1 is the Euler class of 
the bundle, assuming an identification of the suitable cohomology group with 
the integers. All other bundles are denoted by the symbol ®; those with 
asterisks are not distinguishable by their stable class or any characteristic 


SPACES WITH INVOLUTION. 


539 


class. Finally, for a given value of n, two bundles äppear in the same row 
if and only if they are stably equivalent. 


k-plane bundles over Pr for n£ 4. 


rm 3 
k=? .k>3 
2T kT 
L+T, {4a | i> 0} L+(k—1)T 
23L .. 2L-+ (k—2)T 
{Aaya | 4> 0} ` 3L + (k—3)T 
n=3 
k=2 hes 
2T “CHT 
LET L+ (k—1)T 
2L 2L + (k—2)T 
3L + (k—3)T 
n= 4 
k=? k==8 k=4 k>5 
2r 3T 4T kT 
L+T L+27,@*  L-+3T, {Ba]|i> 0} L4 (k—1)T 
aL 2L+-T,O® 264-27, 2L + (k—2)T 
3L 3L +T, {Cx | i> 0} 3L + (k—3)T 
4L 4L + (k—4)T 
{Bua | i> 0} BL + (k—5)T 
® @Q—>6L-+ (k—6)T 
{Ca | 4 > 0} @>IL+ (k—?T)T 


Remark. The Euler classes are calculated by examining: 


Po Pe . 
Tai? (Aq) ——> Tra (An) —— Tha (99) 


where p is the usual projection, and using the fact that pọ corresponds, under 
©, to passing to the bundle over 8” induced by the two-fold covering 8*-» Pr. 
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A FINITELY PRESENTED GROUP WHOSE 3-DIMENSIONAL 
INTEGRAL HOMOLOGY IS NOT FINITELY GENERATED.* 


By JOHN STALLINGS.* 


The aim of this note is to provide a counterexample to a conjecture about 
the niceness of finitely presented groups. This also gives a counterexample 
to a conjecture about m,(K), where K is a finite complex. 


EXAMPLE. The group G with presentation 


{a, b, 6, T, y : [z, al, [y a], [a, b], Ly, bi, [a*z, cl, [a*y, c], [b-*a, cl} 


with five generators and seven relations has as its 3-dimensional homology 
group with integer coeficients a not finitely generated group. (Note: [u,v] 
== uvu.) 


COROLLARY 1. There is no projective resolution [1] of Z over Z(G) 
which is finitely generated in dimension 3. 


COBOLLARY 2. If K is any finite complex with m (K) =G, then w(K) 
ts not finitely generated, even as a module over m (K). 


1. The Mayer-Vietoris sequence of a free product with Amalgamation. 
The notation (4*B)o denotes the free product of the groups A and B 
with amalgamated subgroup C ([4], p. 29). Dub(A,@) denotes (A, *A2)¢ 
where A, and A, are two copies of A each containing the subgroup O. 

For any group A there is a cell complex X such that m, (X) = A, ma (X) 
== 0 for n 41; let B and € be complexes with similar properties with respect 
‘to the groups Band C. Let f: CM and g: C>% be cellular maps inducing 
certain monomorphisms C-»A, C—>B. Let D denote the union of the 
mapping cylinders Map(f), Map(g), identified along their isimorphic sub- 
complexes which are copies of ©. There is a Mayer-Vietoris sequence ([2], 
p. 87) for the triad (D; Map(f), Map(g)). 


* Received October 12, 1961. 
* This work was supported by a National Science Foundation fellowship. 
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> Han (D) > H,(C) > Hn (Map (f)) D Ha(Map (g)) > ° 


The coefficient group is understood to be a trivial module over all the funda- 
mental groups involved. 


Now, ; 
H,(€)=H,(C); Ha(Map(f)) HR) =H, (4); 


H,„(Map(g)) =H, (8) = Ha (B). 


Finally, since ® is aspherical ([5], p. 160), and since m, (D) = (4 * B)o, 
H,(®) ~ H,((4*B)o). Thus we get the following Mayer-Vietoris sequence: 


+ -> Han ((4* B)o) >H, (C) > Ha(A) @ Hy(B) > > +. 


2. Building up G. Let A denote the free group with basis {a,b}. And 
let B denote its subgroup generated by {a"ba”, n =0, +1,42: }; Bis 
freely generated by these elements and hence has infinite rank. Let C denote - 
Dub(A,B); note the following part of the Mayer-Vietoris sequence, with 
integer coefficients: 


H,(C) > H,(B) > H,(A) @ Hi (A) 


Since H,(B) is not finitely generated and H,(A) is finitely generated, it 
follows that H,(C) is not finitely generated. The following is a presentation 
of C: 


{01 Ge, bD: aba, = abar”, n= 0, £ 1, 2,° - +}. 
Define a group D by the presentation: 


{lr Qa, b, T: TUT? = dy, CATT = Ay, TOTT == ba", 0,60," = agbaz*}. 


The subgroup generated by {a,,@,b} in D can be easily shown to be the 
group C, by the standard method of writing down a presentation of a sub- 
` group ([8]). Since D is finitely presented, H.(D) is finitely generated. 
_ Define G == Dub(D, C). Note the following part of the Mayer Vietoris sequence 
for G. 


H,(@) > H,(C) > H,(D) @ H,(D). 


H,(C) is not finitely generated, while H,(D) is finitely generated. Hence 
H;(@) is not finitely generated. A presentation of G is: 
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{än da, b, ta, T3: Tu? dy, Tabet = Oy, T1011 — Oy, 
DT" == Og, Id" = dar, Tabt — mba", a,ba,* = agbas*}. 


The presentation given at the beginning of this note is a modified form of this. 

The first corollary is an evident consequence of the property of H,(@). 
In the second corollary, if »,(K) were finitely generated over 7,(K), then 
by adding a finite number of 3-cells to K, and some n-cells for n > 3, one 
would obtain an aspherical complex & with finite 3-skeleton and m, (©) = G; 
and this would imply that H,(G@) is finitely generated. 
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ON A CERTAIN SUBGROUP OF THE GROUP OF AN 
ALTERNATING LINK.* 


By Kunio Munasver.* 


1. Introduction. Let L C 8° be a tame oriented link of multiplicity p- 
Let G= (2,22, + +, Unt Tufa: © `m) be a Wirtinger presentation of the 
group G@=-7,(S?—JL) of L, and let 6 be the homomorphism of G onto an 
infinite cyclic group Z = (t:) defined by 6(2,) =t for all i. Let H be the 
kernel of ð. In other words, H is the (normal) subgroup of G, an element of 
which is represented by a loop } in S*— L such that the sum of the linking 
numbers of } with each component of L is zero. Clearly 6 can be uniquely 
extended to the homomorphism 6: JG—>JZ of the integral group rings. 
Then, denoting the Jacobian matrix of G—= (s:r) by || drı/dz; |, the g. c.d. of 
the determinants of all (n—1)X(n—1) minor of | 6(6r/@2,)|| is called 
the reduced Alexander polynomial of L, denoted by A(t). Cf. [1], [8]. 
Since A(t) is defined only to within an arbitrary factor + iA, we may assume 
that A(0) 540, unless A(t) —=0. 

The object of this paper is to show the following 


THEOREM 1.1. Suppose L is an alternating link of multiplicity p, and 
let d be the degree as its polynomial A(t). If A(0)—=+1, then H is free 
of rank d. 


Since in the case u = 1, H coincides with the commutator subgroup [G, G] 
and the reduced Alexander polynomial A(t) becomes the ordinary Alexander 
polynomial A(t) of the knot, Theorem 1.1 implies immediately the following: 


‘THEOREM 1.2. Suppose K is an alternating knot. Then if A(0) =+1, 
[@,@] of the knot group of K is free of rank d. - 


. Recently Neuwirth [6] and Rapaport [7] obtained some results on the 
commutator subgroup [G, @] of the group G of a knot. Many of the argu- 
ments that were made in [6], [7] hold with slight modification in the case 
of the group of a link, if [G, @] is replaced by H. Our proof of Theorem 1.1 
based on these facts. 


* Received November 13, 1962. 


* Part of this paper was prepared while the author was at the University of Toronto, 
Canada. 
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Moreover, it should be noted that in Theorems 1.1 and 1.2, the hypo- 
thesis that L or K be alternating cannot be dropped [2]. 

In the following we do not distinguish exactly between knots and links. 
Therefore by a link (of multiplicity a) is meant an ordinary knot or link 
according as „= 1 or >1. Moreover, the reduced Alexander polynomial 
will be denoted by the same symbol A(t) as in the case p= 1. 

The author acknowledges his gratitude to Professor Fox for his helpful 
suggestions. 


2.. s-surfaces. Let us consider an orientable surface F in S*, as is 
shown in Figure 1 below, consisting of two disks D,, D, to which n bands 
Bi, Ba’ + +, Bu are attached. All B; are twisted once in the same direction, 
and the bands are pairwise disjoint and do not link one another. Let us 
call F a primitive s-surface of type (n,e), where «== + 1 according as the 
twisting is right-handed or left-handed. E.g. Figure 1 shows a primitive 
s-surface of type (3,1). The boundary F of F represents an elementary torus 
link of type (2,n). In other words, F spans an elementary torus link. 


B, 


a 


(Fig. 1) 


Consider two primitive s-surfaces F and F” in 8° of type (n,e) and (m,y). 
Take two disks, D, and D,’ say, from each F and F’ and identify them so that 
the resulting orientable surface #— FU F spans a link, and that F—F 
and f'—F’ are separated, i-e. there exists a 2-sphere 8 in 8* such that 
SO F=D, (=Dy,’) and each component of 8*—8 contains points of 
F—D,. F consists of three disks and n-+m disjoint bands. 7 will be 
called an s-surface. Similarly, given two s-surfaces, we can construct an 
orientable surface spanning a link by identifying two disks, one from each of 
the s-surfaces. In general, by an s-surface is meant an orientable surface 
obtained from a number of primitive s-surfaces by identifying their disks in 
this manner. 
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An identification of this kind leads to the product (in the sense of [4], 
[9]) of two given elementary torus links. Namely we have 


(2.1) Any product of two elementary torus links of type (2,m) and 
(2,7) is represented as the boundary of an s-surface with m-+n bands and 
three disks. 


As another example, Figure 2 shows an identification of two primitive 
s-surfaces of type (2,1) and (2,—1) that nn a surface spanning the 
figure-eight knot. 


(Fig. 2) 
3. Alternating links. 


Lemma 3.1. Any alternating link L for which A(0)=-+1, can be 
spanned by an s-surface. 


Proof. Let p be a regular projection of L into 8°. Suppose that p(Z) 
is connected and alternating [1]. p(Z) possesses an orientation inherited 
from that of L. Now p(L) is decomposed into a number of oriented circuits 
called Seifert circutts, in such a way that no two Seifert circuits have any 
side of p(Z) in common [1], [5]. A Seifert circuit C is said to be the first 
type if C bounds a 2-cell in S?—-p(L). Otherwise Ọ is of the second type. 
Let us suppose that there are m Seifert circuits Cy,- --,C, of the second 
type. Since the underlying space | C;| of C; is a simple closed curve in 8%, 
it divides S? into simply connected domains | C,|* and |C4|®. Let 
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Ry," y sym) = Cl (| [68 rn on | Cn |y=), 


yı being a or 8. Then only m+ 1 of the sets R(y:,° + ",ym) are non-empty. 
Let them be Ri, > +, Rm. Zu consists of some Seifert circuits of the second 
type, and two different domains A, and Rj have at most one Seifert circuit 
of the second type in common. 

Now p+(p(L) N R;) consists of some simple arcs in S*. Their end points 
can be joined together in such a way that a special alternating link L; results 
and p(L;)—=p(L) OR, We then write D==L,*--+-*Igy. Since Lisa 
link for which A(0) = = 1, each L; is a product of elementary torus links 
(Theorem 3.28 in [5]). Therefore, by (2.1), L; is spanned by an s-surface Fy. 
Suppose R, and Ry have a Seifert circuit Cy of the second type in common. 
Let r and s be the number of Seifert circuits contained in A, and RB, Then 
F, and F, contain just r and s disks, each of whose boundaries corresponds 
to a Seifert circuit. Let D and D’ be disks of F; and F} corresponding to a 
common Seifert circuit C,. Then we can identify D and D’ in such a way 
that the resulting s-surface F, U F} spans a link L* L; Thus, by performing 
the identification m times in this way, we obtain the required s-surface 
spannning the link L= L +- - -* Ip. 


4. Proofs of theorems. Let § be an s-surface in S® and let U be an 
open regular neighborhood (in the sense of [11]) of the interior of 8 in 8°. 
U is the union of two surfaces S* and 8” whose intersection is $ and which 
span 8. Then the inclusion maps ¢*: 8*>8°— U and ¢?: 9 > 8° — U 
induce homomorphisms 


px + Wy (S#) > m, ($3 — U) 
and 
py: ay (8°) > m (8 — U). 


We claim, moreover, the following : 
LEMMA 4.1. $*, and t, are isomorphisms onto. 


Proof. Proof need be made only for #%,. If 8 is a primitive s-surface of 
type (n,e), then #*, is clearly an isomorphism onto, and it is easy to show 
that +,(8*) and 7,(S*—JU) are free groups of the same rank n—1, and 
are freely generated by bn' ' +, dn. and fi," - ",Anı respectively. Each b: 
is represented by a simple closed curve on S* that passes through two adjacent 
bands of S*, and each £; is represented by a loop winding once around a band. 

Now let S be an s-surface obtained from an s-surface F, and a primitive 
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s-surface F, of type (n,«) by identifying their disks. For the sake of sim- 
plieity we suppose «==1. Let U; be open regular neighborhoods of the interiors: 
of F, in S*. Because of the properties of the identification, we may take 
U,U U, as an open regular neighborhood U of S. Then S*= F,* U Faf, 
8? = FU F}, where F,*, F have the meaning analogous to that of S#, 9°. 
We may assume inductively that 


(4.1) (1) The inclusion map y*: F,” —> S*— U; induces an isomor- 
phism onto between their fundamental groups, (t= 1,2), and 

(2) mı(Fı*) and +,(8®—U,) are free groups of rank r, generated by . 
Gh,’ © +d, and @,° + +, a, respectively. 





(Fig. 3) 


Now 7,(S*) is a free product of two free groups m (F;*) and 7,(F2*) 
amalgamated on the subgroup m, (F,*N F.*). Since this subgroup is trivial, 
wi(S*) is the free group freely generated by a,,' + -:,@, and by,‘ * +, Ona 
On the other hand, since m (S?—U) is a free product of two free groups 
a(S?—U;) and m (8°— U2), m(S?—U) is a free group freely generated 
by ai,° + +, % and Bi," - *, Bua. 

Let D be an identified disk of S and suppose that the bands attached to D 
are arranged in cyclic order as follows: B’s,:--,B’, Bi,+ ++, Buy Bau Bin 
By 3 Bay Bara’ > Ba, Where B; and B’; are bands of F, and Fa. 
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Let a; (¢——1,- ++, p) and £; (j=1,2;- »Ai=n—1) be elements repre- 
sented by loops winding once around B; and a B/. We may assume, moreover, 
without loss of generality, that there is a regular projection of L whose image 
in the neighborhood of D will be shown in Figure 3. (We have only to 
deform L isotopically, if necessary.) 

Then by choosing the base point P of 7,(8*) in Ff N Pt , the induced 
homomorphism ¢*, is given by 


(4.2) pta (t) = yfi (t), i= 1,2, 7, 
B» for 1SjSM—l, 
(AraAra o Arp (Aa Aa) 
pty (bj) — for j= àr, k=1,:  ,1—1, 
(Ants + Art) B(Ar + +s), 
for HIS] S Anl, 
E RR EN 


where Ay= Gapapa" Rao for h—=1,---+,l—1, w0, and Aom]. 
Thus since by the assumption of induction y¢*,4 is an isomorphism onto, it 
follows that #*, is also an isomorphism onto. 

As remarked in $1, Lemma 4.1, „and a nen en of Theorem 1° 
in [6] imply that 


LEMMA 4.2. His a free group. 


Moreover, if H is free, then a slight modification of results of Theorem 1 
and Theorem 3, Corollary in [7] also show that the rank of H must be the 
` degree of A(t) and A(0)— + 1. Thus we obtain the following 


THEOREM 4.3. Let S be an s-surface and let d be the degree of the 
reduced Alexander polynomial A(t) of a link 8. Then H is free of rank d 
and A(0) == + 1. 


Theorems 1.1 and 1.2 follow from Lemma 3.1 and Theorem 4.8. 


Remark 1. Any s-surface $ is one of the surfaces with minimum genus 
spanning the oriented link §. Because, let h be the genus of 8. Since H is 
free and inclusion maps 8*> (S*—U) and S?—> (8°— U) induce isomor- 
phisms onto, the proof of Theorem 1 in [6] can be modified to hold in the 
case of the group of a link. Thus the rank d of H must be 2h-++-~—1. On 
the other hand, since d& 2g + p— 1, g denoting the genus of 8,.we see 
€S2g+y—1S2h-+p—1—d. Therefore g h. d is equal to N-— M 
-+ 1, where N and M denote the number of bands and disks of 8. 
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Remark 2. ‘Generally the converse of Theorem 4.3 does not hold. For 


example, 94, in [8] cannot be spanned by any s-surface, but its group G and 
polynomial A(¢) satisfy the conclusion in Theorem 4. 3. 
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ON GROUPS OF. MEASURE PRESERVING TRANSFORMATIONS. 
: aie IL* 


_ By H. A. Dyr 


1.. Introduction. In this paper we resume the study, begun in [3], of 
automorphism groups of finite non-atomic measure alegbras, the main object 
of the theory being the classification of such groups up to weak equivalence. _ 
Each group @ of measure preserving automorphisms is immersed in a full - 
group [@], consisting of all automorphisms « admitting a representation 
a(H) — 2 Qog (E), for appropriate elements Q, of the measure algebra, and 

ge 


two groups are called weakly equivalent if their corresponding full groups 
are conjugate, in the usual sense of ergodie theory. A striking feature of this 
equivalence concept is its coarseness. It is a common occurrence for groups 
with no familiar algebraic features in common to be weakly equivalent, and 
similarly, diverse action characteristics do -not affect weak equivalence. 
Perhaps significantly, we as yet possess no examples of an abstract group 
having two inequivalent faithful repersentations as freely acting ergodic auto- 
morphism groups of a separable non-atomic measure algebra. 

The main results in [3] concerned approximately finite groups: an auto- 
morphism group @ is called approximately finite if elements in each finite 
subset of G can be approximated arbitrarily closely in the natural metric of 
[@] by elements in an appropriate finite subgroup of [@]. In this form, the 
definition of approximate finiteness leads rather quickly. to a structure and 
equivalence theory. However, it is usually a major technical problem to 
verify whether a given automorphism group satisfies this definition. This 
problem serves as the point of.departure for the present paper. Specifically, 
we consider a freely acting automorphism group @ which is generated by a 
symunteric finite subset F, and attempt to cast the definition. of approximate 
finiteness in an equivalent form more accessible in testing examples. An 
equivalent form is found, in Proposition 4.1, with which we are able to 
establish a criterion (Theorem 1) for approximate finiteness of @ in terms of 
its group structure alone. This is a statement that if the powers Fr of F 
do not grow too rapidly, in a certain sense, then @ is approximately finite. 


* Received August 27, 1962. 
1 This research was supported in part by NSF grant 18999. 
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The criterion is satisfied by all abelian groups, and as we point out in 
Section 6, this leads to a generalization of a result of Murray-von Neumann 
on approximately finite factors. 

In Section 5, carrying on the same theme—characterization of the weak 
equivalence type of an automorphism group by ‘its abstract group structure 
alone—, we show that two full groups of type II are weakly equivalent if 
and only if they are isomorphic as groups (Theorem 2). Our technique in 
proof is to develop a structure theory for such groups sufficient to show that 
local subgroups Gp of a full group G of tipe II can be distinguished internally 
in @ as an abstract group. 

In an appendix to this paper, Section 6, we discuss certain full groups 
of measure preserving automorphisms which arise in the study of regular 
maximal abelian subalgebras of finite von Neumann algebras. The approxi- 
mate finiteness of these groups entails the approximate finiteness of the 
corresponding von Neumann algebras, so that a basis is provided for applica- 
tion of certain results of this theory to the study of von Neumann algebras. 


2. Technical preliminaries. We give a brief resume of the terminology 
developed in [3]. The objects under study are groups of measure preserving 
(— MP) automorphisms of finite non-atomic measure algebras. For technical 
reasons, it is convenient to deal with what we term “hyperstonian measure 
spaces” raher than with general measure algebras (though nothing is lost, 
for with each finite measure algebra is associated a uniquely determined 
hyperstonian measure space having the same measure algebra. A hyperstonian 
measure space (M,A) is a pair consisting of (1) an abelian C*-algebra M 
with identity I, in which each bounded collection of self-adjoint elements has 
a least upper bound in M, relative to the usual order, and (2) a positive 
linear function A on M with A(I) =1 which is faithful, in the sense that the 
only positive element in the kernel of A is 0, and normal, in the sense that 
A(LUBe Aa) =LUBaA(Aa), for each bounded collection of self-adjoint 
elements Aw closed under the formation of finite joins. Mp denotes the 
collection of projections (== self-adjoint idempotents) in M; we assume 
throughout that the measure algebra (Mp,A) is non-atomic. 

Given a group G of MP automorphisms of (M,A), we denote by Ze 
the fixed algebra of G, that is, the collection of all elements in M fixed under 
each automorphism in G. A projection P is called abelian over Ze if P40 
and each projection Q =P has the form Q = PC, for some O in Ze. G is of 
type I if each non-zero projection dominates a projection abelian over Zag, 
and G is of type II if no projections abelian over Zg exist. If a and ß are ! 
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MP automorphisms, then F(a, 8) denotes the maximal projection F such 
that «(P) =£(P), for all PSF. The full group [@] determined by G is 
the collection of all MP automorphisms « such that LUBygegF(a,9) =I, 
and a group @ is called full if [G] = @. On the other hand, if F(g,h) =0 
for each pair g5<A in G, then G is called freely-acting. If K is a full sub- 
group of [G] and ge G, then #(K,g) denotes the projection Lub... gF (g, k). 
The MP automorphism group @ is called approximately finite if, for each finite 
subset F of G and each « > 0, there exists a type I subgroup K of [@] such 
that A(E([K],2)) >1—., for all se F. (An equivalent definition results 
here if one replaces “type I subgroup” by “finite subgroup.”) 

Given an MP group G on (M,A) and an MP group Œ on (W, X), we 
say that G is weakly equivalent to G” if there exists an isomorphism 9 of M 
on M’ such that [806°] = [@]. Here isomorphism means only C*-algebra 
isomorphism ; # is not required to be measure preserving. In any case, how- 
ever, one will have 6(Hz,(A)) = Hz,(6(A)), for all A€ M, where F,,(A) 
denotes the conditional expectation of A relative to the fixed algebra Z of @, 
and so, for example, 6 will conserve measure when the groups are ergodic. 


3. Determining functions. Let G be a group of MP automorphisms 
of the non-atomic hyperstonian measure space (M,A). By a determining 
function on G we mean a mapping t—> EH, of @ into Mp satisfying 


(8.1) E,Hs— Hwy, (for all zy) and Es =I. 


For example, if P is a fixed projection, and if one sets E,—PxP (xe) 
and E, = I, then Fs satisfies (3.1). Similarly, Es = F (z,e) is a determining 
function. There are several useful elementary observations: (1) any deter- 
mining function satisfies c#,1-—H, (as one sees by substituting y= s+ 
in (3.1) and using a symmetry argument): (2) if E, and F, are deter- 
mining functions, then E,F, is a determining function; (3) determining 
functions on a subgroup of a group can be extended to the group in various 
ways. ‘There is the trivial extension: if #, is defined on the subgroup H of G, 
and if one sets Fe== E, (£ in H) and F,—0 (zin G not H), then F, is a 
determining function on G. On the other hand, suppose @ is freely-acting. 
Then each a in [@] has a unique representation «== 20% x)z (where 
ze 


Q(4,2) —=zF(a,2)). Now if Es is a determining function on G, then the 
function Ex = 2 0 (4,0) He is a determining function on [@], which we 
gE 


shall term the natural extension of E, to [@]. 
Given a determining function Fs on G, we associate with Fẹ a full sub- 
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group K(E,) of [Q] in the following way. Let K=K(E,) be the set of 

all æ in [@] which admits a representation a == = Qez with Qx= Es for all z. 

Kisa subgroup of [G]: if a— > Qst and Sun = IRe with SE, Z En, 
then a18 = =z [Larder Reyly, and ~~ 


2 TQ at Ray = 2 OR EEn == 2 2710.0 Raley S Ey, 


showing that «BE K. And K is full: each « in [K] has a representation 
a = D Ryan with Oy > Q (n, x) 2, Q (n, 2) <E, so that 


am LERO (m x)]r and 2 40 (n, 2) SIRE. — En 


We will call K (Ez) the subgroup of [G] determined by Be. 


Conversely, let K be a full subgroup of [G]. Then the function 
E(K, <) =LUB,.z2F(z,k) is a determining function: 


E(K, 2)2E (K,y) =LUB, rex tF (a, h)ayF(y,k) 
| = LUB,, x0 (z, h)oyF (y, htk) = LUB, sex 2F (2, h)ayF (hy, k) 
== LUB, ‚ex TF (2,h) ayF (2y, k) — E (K, £) E (K, cy), 


a clearly, E(K, e) al. 


Lumata 3.1. For any full subgroup K of [G], K(E(K,2)) =K. For 
any determining function Es on G, Eo S E(K (E+), £), equality holding for 
all x if and only if Es = F (2,6) for all z. 


Proof. If a == = eet with Q0.=SE(K,r) for all x, then «a lies in K: 


for, by [3, Lemma 3. 4, there exist elements 8, in K such that Q,8, = Qst, 
and because K is full, «=D 0,8,» must lie in K. On the other hand, if 
a = 2, Qas is any representation of «€ K in terms of G, then Qo% = Q, for 


. alla, and the lemma just cited ‘forces Qa S E(K, <). Therefore, K(E(K,r)) 

=K. 
i Given a determining function Es, write K (E.s) — K. We can express 
d— F(z,e))E, in the form 2 Pw where the P, are mutually orthogonal and 


P,2'P, = 0 for each n. The mapping Pe + rPe t + (I— (Pa + zP) je 

is then an element of K (E), and by the preceding paragraph, Pa << E (K, 7T). 

Therefore, (I—F(z,e))E.SE(K,r). Already F(z,e) SE(K,r), so it 

follows that #,=E(R,z). Now assume that #,= F(a,e) for all s. We 

claim that E (K, s) SEs. In fact, take any P such that Pz =— Pa, for fixed 

zinGandain Kk. If a= 2 Out, then Q,P2 = Q,Py for each y. This entails 
Y 
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QP < yF (z, y) =yF(y'z,e), and since F(y*z, e) < By. and Q, & 37 we. 
have Q,P S EyyB yo = EEn S< E.. Consequently, P—. >> Q,P=E, and we 
have E(K, <) SE, completing the proof. 

We proceed now with the assumption that @ is freely-acting. If E, is 
any determining function on G, then clearly Es = F(a, e) for all z, so by the ` 
lemma, Es > K(E,) > E (K (E.), 2) establishes a. mutual 1:1 correspondence _ 
between determining functions on @ and full subgroups of [@]. It is not 
hard to identify the subgroup corresponding to the product of two determining 
functions Es and Fa, nor the subgroup corresponding to PzP (P fixed). In 
fact, T: 

(8.2) B(B,F.) —K (Bs) N K (Fe), 


and 
(3.8) PzP=E([@]»;2) (ae). 


(3.2) is a restatement of [8, Lemma 5.5]. To prove (3.3), take a in [@]p i 
(=[a€ [@]| F(a, 6) 2I—P]), «= £ Qlar)r. If xe, the free action 
. sed i : 


of G forces F(z;a) SP, and we have Q(a,c) = zF (2,4) = aF (z,a). So 
on the one hand, Q(a,2)—=zF(z,«e) <zP, and on the other Q(a,z) 
= aF (2,4) S aP =P, forcing Q(a,r) = PrP. Conversely, if a lies in the 
subgroup of [@] determined by PzP, we can write a = J, Qar with Q,=PzP. 
for syte. Then if QSI—P, a(0) — 0.04 3,9-PaP2Q— Q.Q, forcing 


a(Q) = Q. This implies that a€ [@]p. 
Let E, be a determining function on the freely-acting group G, and write 
K=K(E,). We associate with E, the extended real-valued function E =a $ Es 


(== LUB? Sr E., F ranging over finite subsets of @) on the spectrum of M, 
o 


which we call the type function of K. When E is bounded, we shall consider 
it as an element of M. We call E finite almost everywhere if there exists an 
increasing sequence Q, of projections in M with LUB I such that each $ F.Qn 


is bounded. (An equivalent definition is this: # is finite almost everywhere nE 


if each projection Q £0 dominates a P 40 such that PE,=0 for all except, 
finitely many z.) . 


Proposition 3.1. In order that K be of type I, it is necessary and 
sufficient that its type function be finite almost everywhere. When the type 
function E is finite a.e, there exist mutually orthogonal projections Da in 
the fixed algebra Zg of K such that È D, —I, Kp, is of type I, on D,M, 
and E == D nDy. 
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Proof. Observe first that Zg = [A € M | EsA — EszA for all z in @]. 
In fact, if FA = EtA for all v and if «= %0(a,r)z lies in K, then: we 
a 


have Q(a,2) SE. so that a(A)= E Q (a, 1)EstA — J Q («, 1) EsA = A, 
and A€ Zg. On the other hand, since E(K,z) — LUB«mz Q (a,2), A in Zg 
entails Q (a, z)tA — Q (a,x) A for all « in K, and EstA = E,A follows because 
E,=E(K,r). 

Assume now that E — $, Es is bounded, and write ¢ (4) = E+ X Hw. 
Then 
(8.4) _ $(A) =Er(A), 


where Ez, denotes conditional expectation relative to Zr. For this we have to. 
show that ¢(A) € Zg, for all A in M, and that A(¢(4)B) =A(AB), for all B in 
Zg. First, note that E € Zr: Ly => Eyl, => LE y= >, HE, = EyE, 


and by the preceding paragraph, EeZr. In the same way, it follows that 

Ey (4) = Ep (4), for any A in M, whence (A) € Zg. Finally, A(¢(A)B) 

— DA(E*E, (yA) B) = X à ( (7E,) EAB) = Z A(E,-E7AB) = d(AB), 
y Yy Yy 


proving (3.4). 

By the structure theory in [3, Section 4], there exist uniquely determined 
mutually orthogonal projections De, Du Da, -+ in Zg having LUBJ, and such 
that Kp, is of type I, on D,M (n finite) and Kpa is of type II on DeM. 

Assume that D, +40. We will show that for no 04PSD, is X PE, 
bounded. Using an indirect proof, assume to the contrary that $, PEs < mI 
for.some integer m and some 0 4P S Do. Put F,=PıPE, (re), F,=I. 
Then X Fe mI and, by (3.2) and (3.3), Fy—=H(Kp,x). Let L denote the 
fixed algebra of Kp. Then by (8.4), (È Fe) FaA—Er(A). Now Kp 
is of type II on PM, and so by Maharam’s lemma [8, p. 124], there exists a 
projection Q SP such that Er(Q) —P/2m. It follows that l 


ZF = (X F,)P/2m S P/2. 


. By the nature of the left-hand term, this forces $ F.z2Q = 0, Er(Q) =0, a 
‘contradiction. Therefore, if F is finite a. e., then K has no type II summands. 
Now assume that K is of type J (that is, De = 0). There exists a freely- 
acting group K,, of order n acting on D,M which is equivalent to Kp, on D,M. 
Each kin K„ has a unique representation k — 206, z)c with > Q(k, £) = Da. 

4 oc © 


Now BK, e) Dam EIE] 2)Dx— 3 Q(k,x), so that 


LED, = Xl X (k, s)]= 3 [LO(kz)] = E Dn, =nD,. 
© @ kekn ken o keKn 
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It follows that E == > Es = >. nD, is finite a.e., and the lemma is proved. 


In order, therefore, that the subgroup K of the proposition be of type II, 
it is necessary and sufficient that, for each P>540, one have P#,40 for 
infinitely many z. 

Continuing in the case @ freely-acting, we give now an explicit method 
for construction of determining functions which is useful in the study of 
approximately finite groups. Let F be a finite subset of G which is symmetric 
in the sense that see F—F". The subgroup H of @ generated by F is then 


simply Ü F*, We suppose that a mapping <> P(x) of F into Mp is given 
„1 
which satisfies 
(3.5) P(e)—=I, P(x) =2P(x"). 
(For example, if F, is a determining function on G, then the mapping 
P(z) =F,, defined for x in F, satisfies (3.5).) For each integer k= 1, 
m 
write F, «=F and form the cartesian products F™ m= J] F}. Denote by Ra 
C Ki 
the set of all (m,' '',2„) in UF such that 4:-.-¢,—2. In tum, 
ma 
denote by Ra? those (2,,' + *,z,) in Es with the additional property that 
Ti TaT,” * *, 21° © Ea (=T) are distinct elements of G. For (a1,° - +, 2») 
in Ra, define 
8.6) Plan + +, 2m) = P(a1)aP (T3) ` (Me `La) P (Ta); 
and finally, define 
(3.7) Es = LUB(e, +, a5) in Bp P (To * *, Bn). 
Lemma 3.2. (i) Es is a determining function on H; (ii) 
Be LUB (a, mens Pla > *, 25) 5 
(ili) if the original function P(x) arises by restriction of a determining 
function Fe to F, then Es S Fe, equality holding on F; (iv) in order that the 


type function E of E, be bounded, it is necessary and suficient that E, vanish 
off a finite subset of H. 


Proof. (i) From (3.5) and (3.6), one has the identities 


Plan; - at) (ut zt)P(z,' + +, En) 
and 
P(a,;° Ta Tass © `y Dmm) 
= P(T, + +5 En) (2123 ° En) P (Em * *y nem): 
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So, if (2° *, 2n) € Ry and (21° ` `, Zm) € Ray, then 
P(as,- *,)P(21° + +» %m) 


= P(2,- Br ` En) TaT: r “Tn [P (27; A +, Gt) ty? . "aP (zy A 52m) | 
= Pla, m) Plant, +, Oe, May tm) S Eat E atay 
— Ë £y. 


It follows that BaBey < EasEy. On the other hand, if (a:,- - -,@,) € Re and 
(9° ` +> Ym) € By, then 


P (z, 7 +, Tn) EP (Yy: ` "5 Ym) 
— P(a,° 7 +) P (23 Yun" * Ym) S Ek ay. 


Therefore, B,cH, < E,E.,. Obviously Z,—1, and it follows that Es satisfies ` 
(3.1) and is therefore a determining function on H. 


(ii) Suppose (z,,° * +, a) € AR, and that the repetition 
Ta lit Bp © Brae (r,s =1) 
occurs IM Zy Tiga’ * 212a * `La Then Eea Beye se and 
(aig? © y Er Eris * "5 Ta) € Re 


We claim that P (21° + °, 2a) L P (T ‚m rss’ © Tn). In fact, 
| P(t," + +, Bx) 


== Paz," ©, ty) (Gita > ©) [P(E * Zr)" Braa P (Brees y Bn) 
= Pla, 0) el Plön‘ * "5 Seas) P (Breasts? °°» En] 

SP(x,,° i + Dp) By" É Erb (Trs 5 * Tn) 

= Pa," +5 Bry Tran’ ' Zn). 


Continuation of this process for a finite number of steps will eliminate repeti- 
tions and give the inequality Es = LUB im, on) ERa P (21° * ',2n). But the 
inequality = is automatic, and (ii) follows. 


(iii) Given F,=P(xz) (x in F), we have 
Pau‘ z * Dn) = Foti y* ia (m: 2 "n) Fon = Fal ae” © Enon 


making repeated use of = 1). This shows that P(2,: >° +, 2a) S Fac ow 
Therefore, putting T= T1 ` ` Ty, E,=F, H c¢ FP, then FoP (2) S Ens, 
so F, == Ep l 


(iv) Suppose that the ‘ype function is bounded by the inper n. Let 
x be any element of H not in Ù F*, and suppose H,£0. Then Pigs: *, 2m) 
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5&0, for some (zu, ` ',&m) in Rs’, and by the nature of z, m>n. But 

P (2u > +, %m) == P(t, 22) © "P(zu + +, Em) S Bese’ Eoen - This 

shows that XE, = m on a non-void clopen set, contradicting $ Es S&S n < m. 
g a 


It follows that #, vanishes off the finite set Ü F*. This proves the lemma. 
= . A 


4, Approximate finiteness. Using the methods of Section 3, we now 
undertake to determine conditions on a freely-acting group G, both in terms 
of its action and its algebraic structure, which will entail the approximate 
finiteness of @. 

Let F be a symmetric finite subset of G. We say that a projection P is 
F-dispersed if there exists an integer n, such that, for each n >n, and 
each n-tuple (21,--°,@n) (21€ F) with 2,212, ° * -,2,° + 2, distinct (viz. 
(2° + +, En) E Ba), one has PU nP U: +> Ua + eaP =I. 


Proposition 4.1. In order that the freely-acting group G be approzt- 
mately finite, it is necessary and suficient that, for each symmetric finite 
subset F of G, there exist F-dispersed projections of arbitrarily small measures. 


Proof. Assume @ approximately finite, and let F be a symmetric finite 
subset. Given « > 0, we can choose a full bounded type I subgroup K of [@] 
such that A(P) > 1—«, where we set J| Z(K,2)=P. We contend that 

: wer 


I—P is F-dispersed. To see this, put P(x)—=E(K,z) (zin F), and let Fe 
be the determining function constructed from the function P(x) on F by the 
procedure of Lemma 3.2. By that lemma we have F,=E(K,x) for z in F, 
and #,SE(K,y) for all y. It follows that P= I] Fs and that the type 


sF 


function of F, is bounded. Therefore, by Lemma 3.2, F, has finite support. 
It follows that there exists an n, such that F,,...¢,—=0 a honexer (t1,° © +, Zn) 
E Rz. and n> no. For each ntuple, 


PaP: + +o: P= P(t, 0) Sanam 0. 
Taking complements, it follows that I — P is F-dispersed. 


. Assume conversely that for each symmetric finite subset F of G, there 
exist F-dispersed projections of arbitrarily small measure. Given a (sym- 
metric) finite subset F and an e> 0, we want to construct a type I a: 
K of [@] such that A(E([K],z)) >1—e for all z in F. 

For this, let 7—P be an F-dispersed projections with A(Z— P) <e/R. 
Set P(t) = PaP (z in F, ze), P(e) =I, and let E, be the determining 
function constructed from this P(z) by Lemma 3.2. By the choice of P, 
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there exists an n, such that P (z1, -© *, 2a) = 0 whenever (t%,---,2,) lies 
in Rem? and n>. It follows that Es .--e,==0 for such n-tuples. We 
conclude that Es has finite support, and therefore it determines a type I 
subgroup of [@]. Since E, Z= PaP for z in F, we have A(E,) > 1—e, and 
the proposition is proved. 

From the definition of approximate finiteness, it is clear that a group 
is approximately finite if each finitely generated subgroup is approximately 
finite. In turn, if the group @ is generated by a finite subset F, and if the 
condition defining approximate finiteness holds for elements in this particular 
finite subset F, then it is straightforward to show that G is approximately 
finite. Therefore, if the freely-acting group G is generated by a symmetric 
finite subset F, and if there exist F-dispersed projections of arbitrarily small 
measure, then G is approximately finite. 

Given a subset S of G and a projection P, write SP for LUB,es 8P. 


LEMMA 4.1. Let 8 be an arbitrary finite subset of the MP group G, 
and let Q be an arbitrary projection. Let l 


C= (es and P= (CQ) (I— (8S—C)Q), 


F being a symmetric finite subset of G. Then I—P is F-dispersed. 


Proof. Suppose that 2,,a,%2,°-°,% * ‘Tn (EF) are distinct and 
Pz,P,ı: + +a: + -aP 540. We will show that n cannot exceed the number 
| © | of elements in ©. In fact, the projection Pz,P- - -a,- - -%,P must have 
a non-zero intersection R with some CoQ (win C). We claim that a !.,€ 0; 
for by definition of C, wc,€ 8; but n *R SP, which is disjoint from 
(S—C)Q, and because zR Sac S8Q, we must have a,7¢,€ 0. 
Similarly, tatz CoE 8 and 2,12, "RS Perit CoQ, forcing zatr Co € O. 
It follows that my1- - -2,+e,€ C for i=a 1, -+ n. Since these elements are 
all distinct, we conclude that n< |C |. Therefore, if n> |C | and 


(21° © m) E Raan, then PaP: m EP 0. It follows that I—P 
is F-dispersed. 


THEOREM 1. Let G be a freely-acting group generated by a symmetric 
finite subset F. Define hı =] F |, ha= | F"— F" | (n>1). Then, if 


(4.1) inf, hen/ (hi +` > ++ hy) = 0. 
the group Q is approximately finite. 
Proof. Given e> 0, choose n so that han < elha t'> in). Put 
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A=f"r and define S =F” (—A?e= AA) and O— (a8. Because 
ae 
F CC, we have | S—C]| < |F — Pm | =ha <e] A]. 

Let R be a projection maximal with the property that its translates zR 
(z in A) are mutually orthogonal. Since any non-zero projection dominates 
a non-zero projection whose translates under A are mutually orthogonal, it 
follows readily from the maximality of R that I = AAR. We set Q—=AR 
and then, as in Lemma 4.1, set P= (CQ) (I— (S—C)@). By that lemma, 
I—P is F-dispersed. On the other hand, since A(Q) S1/|4A |, we have 
A(I—P) SaA((S—C)Q) S| S—ClA(Q) S|S—C|/|A|<ea We have 
proved that there exist F-dispersed projections of arbitrarily small measure, 
and the theorem follows from the remark following Proposition 4.1. 

It follows that, if @ is an abstract group containing a subset F satisfying 
the conditions of the theorem, then in any faithful representation as a freely- 
acting group of MP automorphisms of a hyperstonian measure space GŒ is 
approximately finite. As an illustration, let Œ be the free product of two 
groups of order 2, and let F consist of the identity and the two generators of 
order 2. Then k, =3 and h,—2 (n>1), and trivially, (4.1) holds. 


LEMMA 4.2. Let G be a freely-acting group which ts the direct product 
of a finite subgroup D with an approzimately finite subgroup K. Then @ is 
approaimately finite. 


Proof. Let F be a finite subset of K and let E, be a determining function 
on K having finite support and such that A(E,) >1—«/|D|, for a pre- 
assigned e>0. (That such exists follows from the results of Section 3.) 
Put Fa = II dB. Then F, is again a determining function on K with 

€ 


finite support, A (F+) >1—e for s in F, and furthermore, F’, lies in the 
fixed algebra Zp of D. If ge G has the (unique) representation g= dk 
(deD,keK), define Fy = Fr. It is trivial to see that F, is a determining 
function on G having finite support and satisfying A(F,) > 1—e, for all g 
m DF. The result follows, since any finite subset of G is contained in a 
finite subset of the form DF. 

With this we establish our main application of Theorem 1. 


COROLLARY 4.1. Any freely-acting abelian group is approximately finite. 


Proof. As we have noted above, it suffices to consider finitely generated 
abelian groups. By the familiar decomposition theorem, a finitely generated 
abelian group @ is the direct product of a finite group and a free abelian 
group on (say) m generators. By Lemma 4.2, it suffices to assume that G is 
in fact free abelian (m>0). Let F consist of e, the m generators and their 
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inverses. By a simple inductive argument, one can show that | Fr | = pm(n), 
where Pm is a polynomial of degree m with rational coefficients. Therefore, 
hon/ (hip: + ++ hm) = [Im (2) — pn (22—1)]/pm(n), and it is clear by 
elementary calculus that (4.1) holds. The corollary now follows from 
Theorem 1. 


5. On the structure of full groups of type II. Let @ be a full type 
II group of MP automorphisms of (M,A), with fixed algebra denoted Z. 
Under the invariant metric 8(¢, 8) =A(I—F(«a,ß)), @ is a topological 
group. Now in [8, Prop. 3.1] we proved that any full normal subgroup of 
G has the form Go, for some (projection) C in Z. We shall require the 
following extension of this characterization. 


Proposition 5.1. Any closed normal subgroup K of G has the form Go, 
for some O in Z. 


Proof. It is easy to see that the full group [K] generated by K will 
itself be normal in @, and therefore, by the result just cited, of the form Go 
(C in Z). Clearly, we can assume in what follows that C—=J, that is, 
[K] =G. The fixed algebra of K will now be Z and, for any projection P, 
its Z-carrier will be LUBzgex kP. Our object is to prove K = @. First we 
prove 


(5.1) Let C, D, R be mutually orthogonal non-zero projections with 
Hy(C) =Ez(D) = Ez(R)/2. Then, given « > 0, there exist projections Co, 
Do, Ro and a p in K with these properties: (i) 040, < 0, Do & D, RSR 
and Ez(C,) = Ez (Do) = Bz(Bo)/2; (i) p(0o) = Do F(e,p%)= Co + Do, 
Plesa) =1—(Co+Do+ R) (iii) MC—C,) <e 

One has RS Z-carrier R = Z-carrier C = LUB peg kC. So we can choose 
060 <C and k in K such that kO S&R. Using Maharam’s lemma, dissect 
C’ = C, + (C—C) so that #z(C,) = #z(C’ —C,), and choose D, = D with 
Ez(D,)=Ez(C.). By [3, Lemma 3.2], there exists an a in G such that 
a(O’ — 01) = D,, F(a, e) =I—[C’ —C,+ Dy], a = identity. Put 8 = aka. 
Then 8€ K by normality of K, and 


B(C, + D1) = ak0, + ak (0—01) = ak" =k SR. 


Similarly, choose a y in @ such that yC, = D., F(y,e) ZI— (0 +D), 
y’ = identity. Put p = Byg “y. Again by normality, p € K. Take P S 0, + D. 
We argue, pP = yP; in fact, yP < Cı -+ D, and 


(Cı + D1)8 (0: +D) S (CL + Di) Bk =0, 
so that (C, + D,)B"(C, + D,) = 0; yis therefore the identity on 8",(0, + D,), 
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and pP = By(B*yP) —BB"yP =—yP, as asserted. Set BR, 8(C,+D;) 
and suppose PSI— (Cı + Dı +5). Then yPP=P=y£"P, so pP =P. 
We have constructed projections C,, D,, R, and p in K which satisfy conditions 
(i) and (ii) of (5.1). The argument now proceeds by exhaustion. Let 
(0:5, Dy", Rı*, p*) (a in a) be a maximal family with the properties (i) and 
(ii) and with the additional property that the C,* are mutually orthogonal 
(respectively, the D,” and the R,* are mutually orthogonal). One must have 
C == $, 1%, for otherwise we could apply the above construction to C— £ 0:5, 
ete., to contradict maximality. Given « > 0, choose a finite subset a, of a such 
that A(C — E 04%) < «, and put p= JT p%, Com > 0,5, ete. Then (Ci, Dz, 
MEO HEN BEL 


Ry, p) satisfies (i) and (ii) and in addition A(O — Co) <e. This proves (5.1). 

We turn to the proposition itself. Let « be an element of G having finite 
order. We will show that « can be approximated arbitrarily closely in the 
ö-metrie by elements of K. It will follow that «€ K, since K is closed. But 
elements of finite order are 8-dense in G ([3, Theorem 1]), and again since K 
is closed, we will have K = G. 

Let Za be the (type I) fixed algebra of œ. Since Za is of type II over 
Z, given §>0, we can choose a positive integer n with 6/(n--3) <ê and 
mutually orthogonal projections P-a, P- Po © °P in Ze with Ez(P,) 
= 1/(n +3). This done, for each i= 1,: - + n, and e==8/2n, apply (5.1) 
to R = Pa +P- C =P, D =Po. By (5.1), there exist p; in K, GSP, 
Di& Po such that pi(Cy) =D, p? = identity on Cr+ Di, p==identity on 
Pi- o (Pi— 0) Hee dP and A(Pi— 0i) <e For +21, let 
a = Pia 4- (I—P;) (well defined since P, lies in Z), te= prap, and 
r==1rj° * tta By construction, rE K. We claim that r==¢ on LU artO, 
In fact, take P & t0; Because PSP, tP = 4P. Because a? is the 
identity on Po, nP = p'ar puluP) = p (aP) = aP =P, verifying the 


claim. Now . . 
MU aid) = EMO) SEP) — 1 = n/ (048) —ne > 1-8. 
ra 4-1 Fl 


Therefore, ö(a,r) <8, and « lies in the closure of K. The proposition is 
proved. 

Given a subgroup H of G, we denote by HL the centralizer of H in G, 
that is, the set of all elements in G which commute with each element of H. 


COROLLARY 5.1. Let H be a subgroup of the full type II group G. In 
order that H have the form Go, for some C in the fixed algebra Z of G, it is 
necessary and sufficient that there exist a subgroup K of G such that H = KL 
and G= HK. : , 
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Proof. Assuming that such a K exists, then H is closed in the topology 
of G, since any centralizer has this property. Also H is normal: if «= hk 
lies in@ (hE H, kE K), then «Hat == hHh"'=-H. Therefore, by Proposi- 
tion 5.1, H = Qo for some C in Z. Conversely, let H = Go (O €Z), and 
set K= Giro). Plainly G=HE. If a=hk (he H,keK) lies in KL, 
then % must lie in the center of K. But this forces k—e; K restricted to 
(I—(C)M is a full type II group, and it is easy to show that any full type II 
group has trivial center. Therefore, « lies in H. 

It follows that local subgroups of @ of the form Gg (O in Zp) are 
characterized by the structure of G as an abstract group. We proceed now 
to show that general local subgroups Gp (P in Mp) can be similarly charac- 
terized. The basis for attack is the observation that any local subgroup of G 
is the centralizer of its centralizer; the technical problem is to sort out local 
subgroups from the class of all subgroups of G having this property. 


- Lemma 5.1. For any finite freely acting subgroup H of a full type IT 
group G, (H+) c [H]. 
Proof. Choose a projection P such that the hP are mutually orthogonal 
and > AP — I. Take pin (H1)1. We will prove that y, E (h, p) Zp” (P). 
hE he 


Substitution of hP for P will then yield UF (h,p) =I, and it will follow 
he 


that pe [H]. For any £ in Gp, it is clear that hBh-*¢ Gap, and therefore 
II Reh" € HL. Fix h, in H and set R= (pP)h,P. Then for any 8 S R, 
he 


PELI hBk*(8)] — phoBho™(8), and TI hBh*p(S) = Bp(8). Because pE (H+)1, 


this implies that (pho)B=—= (pho) on AotR. Now both Ao tRSP and 
pE SP, and by appropriate choice of ß, it is easy to see that Au "RB alt. 
It now follows that ph, commutes with all elements of Gwr, and therefore 
is the identity on ho*R. Thus, hop is the identity on R, that is, F (p, hot) 
= (ptP)hoP. Therefore, U F(p, h*) = £ (p"P)RP=p"P, proving the 
lemma. i i 

By the carrier of a non-vacuous subset A of G, we mean the projection 
LUBaca (I—F(a,¢)) (~ GLB[P € Mp| Gp D AJ). The Z-carrier of A, 
that is, the Z-carrier of its carrier, is then GLB[C€ Zp | GoD A]. In view 
of Corollary 5.1, the statement that two non-vacuous subsets of G have the 
same Z-carrier is purely algebraic (or in other words, depends only on the 
abstract group structure of @). 


Lemma 5.2. Let G be a full type II group with fixed algebra Z. Let H 
and K be subgroups of G in the relation HL—=K, KL =H, HNK = {6}. 
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Assume that the ficed algebras Zu and Zx of H and K coincide with Z. 
Further, assume that any normal subgroup of H with the same Z-carrier as 
H has centralizer K. Then, [H] N [K] is trivial. 


Proof. Take 0340 in Zp and form Ho= [Ch 4+ (I—C)|heH]. 
Evidently Hp C KLH. Likewise Kg CK. We will show that all the 
conditions imposed on H and K as subgroups of G remain valid for the sub- 
groups Ho and Ko of the full type II group Go on CM. To this end, suppose 
a€ Go lies in Hl. Then a= Oa -+ (I—C) lies in Hl=—K, and hence 
a€ Kg. Likewise, the centralizer of Ko in Go is Ho, and obviously, Ho N Ko 
is trivial. The fixed algebra of Ho or Ko coincides with that of Go (viz. 
CZ+(I—C)M). Finally, suppose that N is a normal subgroup of Ho 
with the same Z-carrier as Ho. Then NH r-o) is a normal subgroup of H 
with the same Z-carrier as H. Therefore, its centralizer in Gis K = KoK io). 
It follows that the centralizer of N in Go is Ko. Therefore, our hypotheses 
are invariant under restriction to Z-summands. 

We prove the lemma by an indirect argument: assume that, for certain ele- 
ments hy € H, ky € K, one has (I — F(ho, 6)) F (ho, ko) 340 (so that [H] N[ E] 
is non-trivial). We shall obtain a contradiction. 

To begin, note that for hı, hy in H, F(Ay,h2)€ Zx—=Z. Therefore, 
I—F (fo, e) is a non-zero projection in Z. Dropping to a Z-summand, we 
can assume F(ho, e) =0, retaining the other hypotheses; and in the same 
way, we can assume that Z-carrier F (ho, ko) == I. 

Let A be a subset of the conjugate class O (ho) of ho in H which contains 
ho, whose elements are independent, meaning F(z,y) =0 if ry,2,y in 
A, and which is maximal with these properties. How if z,y€ 4, then 
P(x, ko) F(y, ko) SS F(a, y) = 0; and because of the relation sF (h, k) =F (shs, k) 
(valid for s, h in H, kin K), we see that A(F(2,k))) =A(F(y,k )) (ay 
in A). Therefore, A is finite. For z in O (ho), define H(z) =I — 2, F(z,2). 
Clearly, H(z) € Zp. We claim that LUBseca) H(z) ÆI. Otherwise there 
exist 2, in C(A,) and Cs in Zp, On = E(z,), such that X, Op = I. If Zn == Snort, 
let s = N (0,35. This element s lies in H; H is closed in the topology of G, 

. being a centralizer., In turn, let z= shos. Then for arbitrary x in A, 

F(a, 2) = 3 CaF (T, 2a) SDE (24) (I— E (2n)) = 0. This contradicts the 

maximality of A. Therefore, there exists 074C in Zp such that E F (2,8) 
we 


=C, for each z in C(h,). Dropping to a Z-summand, therefore, we can 
assume = 1 F(a #) = I, for each z in CO (ho). 


Let B be the boolean algebra generated by Z and the projections F (z, ko) 
(zin A). z€ C (ho), then 
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F (2, ko) = X F(2,k,)F(z,2) = £ F(z,2)F(z,ko)€B. 
aed wed 
In particular, then, B is H-invariant. Further, since 
I = Z-carrier F (ho, ko) = LUBaseg SF (ho, ko) = LUBse cca F (z, ko), 


one has © F(z,k,) =I. Therefore, if n==] A|, B is of type I, over Z. 
wei - 


We claim that the representation of H obtained by restricting H to act on B is 
faithful. For this, suppose that s in H determines the identity automorphism 
of B. Then for each z in A, 


F(a, ko) = SF (m, ko) = F (s287, ko) = 2 F (y, srst) F (y, ko), 
ve 


and multiplication by F(z,k,) gives F(z, ko) = F (z, sus*) F (z, ko). There- 
fore, F(z, sxs*) = Z-carrier F(z, ky) = I, proving that s commutes with all 
elements of A. For any z in C(ho), z in A, F(a, szs+) —8F(s-*zs, 2) 
= I(x, 2), so that 


F (sas, 2) = D F (s2, 2) F (g, £) — 2 F (e, 2) E (2,2) =Z P (22) =], 


and s commutes with z. It follows that s lies in the centralizer of the normal 
subgroup N (ho) of H generated by ho. By construction (viz. F (ho, e) = 0), 
this subgroup has carrier J. By assumptions of the lemma, therefore, V1 = K, 
and s€ H N K= {e}. This proves that the restriction of H to B is faithful. 

Let S be the subgroup of H generated by A. Restricted to B, 8 is finite 
([3, Lemma 4.4]). Therefore, 9 is finite. If we form the finite boolean 
algebra generated by the projections F (8,82) in Z (sı, 8 ranging over S), 
then the restriction of 8 to an atom of this algebra is freely acting (after 
identification of elements having the same action on this atom). Dropping 
to a Z-summand again, we can suppose S is freely-acting. Now the relation 
2 F(a, z) =I (ein O(ho)) gives z = $, F(z,z)r. It follows in turn that 
gE # 


each element: in the normal subgroup N (ho) of H generated by h, has a 
representation 3 Oyy (Oyin Z). On this count, S and N(h,) have the same 
yeß 


centralizer, viz. K. Therefore, (9L)L = H, and since Zy =Z, it follows that 
(SL)-l is a group of type II. On the other hand, by Lemma 5.1, (St) is 
_ a subgroup of a type I group, and is therefore of type J. This contradiction 
establishes the lemma. 
Now let H = Gp be a local subgroup of the full type II group G. Since 
the center of H must be trivial, it follows that H1—G zp). Therefore, 


(5.2) If Hl«=K, then KI=H and HN K = {6}. 
H and K also satisfy 
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(5.3) Any normal subgroup N of H (respectively, of K) with the same 
Z-carrier as H (réspectively, as K) has centralizer K (respectively, H). 


This follows since, by Proposition 5.1, the closure N- of N must coincide 
with H, and since, trivially, N and N- have the same centralizer. Finally, 


(5.4) Ifa is an element of G not in HK, then there exists an element 
hein H (respectively, in K) such that «ha lies in K (respectively, in H). 


In fact, if a is not in HK, then PAa(P), and so R—=Pat(I—P) 340. 
Gpr is contained in H, and if h is an element of Gp not 6, then aha? € Garr) 
and Gain) CEK. 


PROPOSITION 5.2. The conditions (5.2), (5.3), and (5.5) characterize 
local subgroups H of a full type II group G. 


Proof. Our task is to show that, if H (and K == HL) are subgroups 
of G satisfying these three conditions, then H is local. Write Za, Zg, and 
Zug (== Za N Zg) for the fixed algebras of H, K, and HK. Let Pa and Pr 
be the carriers of H and K. Our assumptions entail that Py U Pg =]; for 
any a in Gr-prupz lies in both HL and KL, that is, by (5.2), in K N H = {e}. 
Also, both Py and Pr lies in Zag; this follows readily from the definition of 
carrier and the fact that H4 =K, Kl =H. Now let CO be any projection 
in Zur satisfying O < Pa, let © denote the Z-carrier of C, and write 


N= [(I—6+C)h+0—C | keH]. 


Each element of N lies in KL—H and N is evidently normal in H. The 
carrier of N is (I— Ë -+ 0)Pa = (I—)Pa +0, so that the Z-carrier of 
N is (I—C)Px-+CPx—Px. Therefore, by condition (3.2), NL—K. Now 
if he H, then (Ö—C)h+(I—Ö--C) lies in NL, and therefore, because 
HNK = {e}, (6—C)Puy=0. This shows that Zur Pr —ZPa. Likewise, 
ZurPr—ZPx. It follows that Zux is the boolean algebra generated by 
adjunction of Py and Px to Z. As in Lemma 5.2, it follows readily that, for 
each projection C in Zag, the three conditions (6.2)-(5.4) are valid for the 
subgroups Hg and Kg of Go on CM. 

We will prove that PyPxs==0. Using this, it then follows that 
Gras = Grp, C KL =H C Gr, namely, H= Gp, is local, and the proposi- 
tion willbe proved. As the basis of an indirect proof, we assume PauPr 0. 
Dropping to Gp,p, on PuPxM, we retain conditions (5.2)-(5.4), as noted 
above. Therefore, for the sake of notation, we may assume Pa = Pr =I. 
We then'‘have Zar = Z. : 

Next, we show that Zy = Zr —Z. In fact, take OAPCZy. We will 
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show that P is K-invariant. This will prove that P € Zar = Z, showing that 
Za = Z; similarly, Z = Zg will follow. Defne N — [Ph+ I—P |h in H]. 
N is a subgroup of G with carrier P, and hNh* =N for each h in H. If 
we knew that N were a normal subgroup of H, then for each k in K, 
Ph -+ I—P = k(Ph 4 I-—P)kt = (kP)h+I— kP, so kNk* has carrier 
kP; but since the carrier of any normal subgroup of H is readily seen to be 
K-invariant, we would have kP==P. Proceeding indirectly, assume that N 
is not a subgroup of H. Then, an hy in-H exists such that a ==P h, + I — P 
does not lie in H. We consider two cases. Case (i): @ does not lie in HE. 
In this event, by (5.4), there exists h46 in H such that ahate K. Now 
aha = Phohho++ (I—P)h. Because aha! commutes with all elements 
of H, and in particular with ho, we get 


Phohho? + (I—P)h=Ph-+ (I — P)hothho 


so that Phohhọo == Ph, and chat==Ph+ (I—P)h=h€H. Therefore, 
aha" lies in H N K = {e}, a contradiction. Case (ii): a lies in HK not H. 
Thus a=hk (k46). Let L be the normal subgroup of K generated by k. 
We note that each element n of L leaves P fixed. In fact, it suffices to verify 
this for n=uku (u€ K), and one has uku"P — uhkut(hP) =a uau!P 
= u[PhutP + (I—P)utP] = (uP)P+(I—uP)P=P. It follows that 
each n in L commutes with « The carrier Pz of L lies in Za N Zr =Z. The 
subgroup LK zp, of K has the same Z-carrier (namely, I) as K, and 
80 by (5.3), its centralizer is H. But Pra -+ I— PrE (LK1p,)1—H, and 
(I—Pr)a -+ Pr = (I—Pr)h 4+ PrE H, whence 


a= (Pr + (I—Pı)e) (Pra + I— Pz) 


lies in H, a contradiction. Thus we have proved that Zq (and similarly, Zr) 
coincides with Z. 

We can now apply Lemma 3. 2 to conclude that [H] N [K] = {6}. Clearly, 
we can choose « in [H] so that F(a,e) does not lie in Z. Then g does not 
lie in H. (for h in H implies F(h,e) € Eg — Z), and also a does not lie in 
HK; for if «== hk, then k—hte lies in [H] N [K] = {e}. We can apply 
(5.4): there exists an h 546 in H such that ahate K. Because ahate [H], 
we have ahate K N [H] = {6}, a contradiction. Therefore, the assumption 
that PyPx 30 is untenable, and the proposition follows. 

In view, therefore, of Corollary 5.1 and Proposition 5.2, the conditions 
(5.2)-(5.4) provide a purely algebraic characterization of local subgroups of 
G. It is merely the existence of this characterization, rather than its specific 
detail, which is basic in the following 
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TemoREMm 2. Any group isomorphism between two full groups of type II 
ts implemented by a weak equivalence of these groups. 


Proof. Let G and @ be full type II groups on (M,A) and (M’,)’), and 
let ¢ be an isomorphic mapping of G on @°. In view of Corollary 5.1, for 
each projection O in Ze there exists a uniquely determined projection 9(C) in 
Ze such that ¢(@g) = Gog). Application of the same remark to ¢* shows 
that 0 is a 1:1 mapping of Ze on Za. Furthermore, 6 conserves products, for 
Woon) = $ (Gon) = $(GoN Gp) = Hea) N Goin) = Foo. It follows 
that 6 is a boolean isomorphism—a 1:1 mapping between boolean algebras is 
& boolean isomorphism if and only if it conserves products —. In turn, it 
follows that 9 induces a *-isomorphism of Ze on Ze. In particular, then, two 
subgroups in @ have the same Zg-carrier if and only if the corresponding 
subgroups in @’ have the same Zq-carrier. Let H — Gp be an arbitrary local 
subgroup of G. The subgroup H’ = (H) of @ will then satisfy the condi- 
tions (5.2)-(5.4). By Proposition 5.2, H’ will be local, and must therefore 
have the form H’==@’sp), for some projection 6(P) in W’. Now apply 
the argument given above for the pair Zae, Ze to the pair M, M’. It follows 
that ø induces a *-isomorphism of M on M’. Now 


oer) = p (Ger) = p (2Gp) == p (2) Gop) (2) "= G4 (a) (7); 


for all æ in G. This shows that 6(zP)—¢(z)6(P), or in other words, 
p(z) 626. This proves that ¢ is implemented by 6, and the theorem 
follows. f 


6. Appendix: connections with von Neumann algebras. Let M be a 
von Neumann algebra with a faithful normal (numerical) trace Tr. Let H 
be a maximal abelian self-adjoint (== MASA) subalgebra of M having no 
minimal non-zero projections, and let N(H) denote the normalizer of H, 
that is, the eollection of all unitary operators U in M such that UHUT=H. 
In the foregoing terminology, the pair (H, Tr) is a non-atomic hyperstonian 
measure space, and the mapping U —> ¢y, where ¢y(A) == UAU-, is a homo- 
morphism from N(H) into the group of all MP automorphisms of (H, Tr), 
its kernel being the group Hy of all unitaries in H, this by the maximality 
of H. Let us denote by G the group of all such MP automorphisms ¢y 
(VEN(H)). It is trivial that G is a full group; in fact, the most general 
element of [@] must have the form SQadv,, the Q, (respectively, the 
$u.1(Q»)) being mutually orthogonal projections in H with 


= Qa =I (È dun (Qn) =I), 
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and such an automorphism is already implemented by the element V == X, Q,Un 
of N(H) (the > being taken in the strong operator topology). Similarly, if 
N is a von Neumann subalgebra of M containing H—or as we shall say, 
an intermediate subalgebra—then the group K of all ¢y, U ranging over 
N(H) ON, is a full subgroup of G. In operator theory, various concepts of 
type are attached to M and its intermediate subalgebras; similarly, in the 
foregoing study of groups of MP automorphisms, we have attached concepts 
of type to G and its subgroups. Our object now is to compare these termi- 
nologies in the special case when the MASA subalgebra H is regular (Dixmier, 
[2]), that is, when the von Neumann subalgebra R(N(H)) of M generated 
by N(H) is all of M, and to indicate (without elaboration) how some of our 
theorems on MP groups can be carried over to von Neumann algebras. 
Technically, the discussion to follow makes heavy use of the concept of 
conditional expectation in a (finite) von Neumann algebra, and we review this 
matter briefly (see Umegaki, [5]). With M, Tr as above, let N be an arbitrary 
von Neumann subalgebra of M containing the center Z of M. Then, for each 
A in M, there exists a uniquely-determined element Ey(A) of N such that 
Tr(Hy(A)B) = Tr(AB), for all Bin N. Hy(A) is called the conditional 
expectation of A relative to N. (The existence of Hy(A) follows readily from 
a Radon-Nikodym theorem, which shows also that Zy(A) is independent of 
the particular faithful normal trace used on M.) The key properties of Ey 
follow from the defining formula: A —> Hy(A) is a positive *-linear mapping, 
conserving the identity I, and satisfying 
(6.1) Ey (AB) =Ey(A)B, for all A in M, B in N, and 
(6.2) > Ey(A*A) Z Hy(A)*Hy(A), for all A. 
If [A] = (Tr(A*A) )# denotes the trace norm on M, then (6.2) implies that 
[£y(4)]S[A]. When N is the center of M, then Ey is simply the center- 
valued trace on M. 


Lemma 6.1. Let H be a regular MASA subalgebra of M, let N be an 
intermediate von Neumann subalgebra of M, and let K be the full group of 
MP automorphisms of (H,Tr) induced by N(H) NN. Then H is regular 
as a MASA subalgebra of N, and for each U in N(H), there exists a W in 
N(H) ON such that Ey(U) = E(K, $y) W. 

Proof. In view of (6.1) and the fact that H C N, we have 
(6.3) Ey(U)A—¢y(A)Ey(U), 


for all A in H. Let §==[By(U)*Ey(U)]#. Using (6.3) and the fact that 
Ey (U)*—Ey(U~), we have S?A = A§?, for all A in H. By maximality 
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of H, this forces S?€ H. Consequently, SE H. Let Hy(U) —V8 be the 
polar decomposition of Ey(U). Here V is a partial isometry with initial 
projection E = V*V € H and terminal projection F—VV*. Substitution of 
VS for Ey(U) in (6.3) yields ¢y(A) VS = VSA + VAS, and from this and 
the fact that VE = V, we deduce 


(6. 4) $u(A) = VAY*, 


for all A in H. Substitution of # for A in (6.4) shows immediately that 
oy(E) =F. In turn, we deduce readily from (6.4) that V*UA —AV*U, 
for all A in H. This implies that V*U € H, and so V*U = Hy(V*U) 
=V*Hy(U) — 58. Thus V*U is a non-negative self-adjoint partial isometry 
in H, and consequently, a projection. Therefore, S = F, and Hy(U) =F. 
We note that VHV* C H, by (6.4), and also that V*HV C H, by the same 
argument applied to U. 

We claim that we can extend V to a unitary Win N(H) ON. For this 
purpose, by Zorn, it evidently suffices to prove the following: if V is a 
partial isometry in N, with initial and terminal projections in H, and with 
VHV* CH, V*HV C H, then if V admits no proper extension satisfying 
these conditions, it must already be unitary. Suppose to the contrary that 
V*V =E I. Then, by the finiteness of N, VV*—F AI, and I—E and 
I—F are equivalent mod N. So there exists a partial isometry T in N such 
that T*T =I— E and TT*—I—F. Making our first use of regularity of 
H, given «>0, we can find elements U,,---,U, of N(H) and scalars 


@,* * *, an such that [T— $ ald <e Since Hy is norm-depressing, the 
a . 


same inequality holds with By (Ui) replacing U,. Using the first part of the 
proof, let V, be the partial isometries in N such that Hy(Uy) = Vi. I we 
choose e < [T] and observe that [7 — Yu (I— F)V,(I—E)]< e, we deduce 
that some V’ = (I—F)V,(I—E) is #0. But V’ is a partial isometry 
(since H is abelian) with initial projection < I— F, terminal projection 
=I—F, such thatV’HV"* C H, V’*HV’ CH. It follows that V+ V’ is a 
partial isometry properly extending V and having the same properties. This 
contradiction establishes our claim. 
We have proved that #y(U) has the form FW, for some projection F in 
H and some W in N(H) NN. It follows immediately that F¢y(A) — F¢w(A), 
for all A in H, so that FSE(K,$v). On the other hand, writing 
E,— E (K, $v), we know by [3, Lemma 3.4] that there exists a gy in K 
. such that Fipw (4) =Eıgv(A), for all A in H. From this relation and 
the maximality of H, we deduce that Z,UW-"eH, and in turn, that 
E,U = E,W., for some W, in N(H) NN. Now 
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(1—F)B,U = (I—F) By(E,U) =0, 


and this shows that ([— F)E,—=0, or ESF. Accordingly, F = E (K, $v). 
It remains only to prove that H is a regular MASA subalgebra of N. To 
this end, let N, denote the von Neumann subalgebra of N generated by 
N(H)NN. The characterization of Fy(U) just obtained shows that, for 
each U in N(H), Ey(U)€N,. This and the regularity of H in M force 
Ey(A) €N, for all A in M. Obviously, therefore, N—N,, and the lemma 
is established. i 
Application of the lemma in the case N == H yields the following criterion : 
in order the ¢p be freely-acting, it is necessary and sufficient that Eg(U) = 0. 


PROPOSITION 6.1. There is a1:1 correspondence between full subgroups 
K of G and intermediate von Neumann subalgebras HCN CHM of M, 
obtained by associating with each full subgroup K the intermediate subalgebra 
R[U | ¢v€K] and with each intermediate subalgebra N the subgroup 
[¢0| VE N(H) NN]. This correspondence conserves type: if N is of type I 
(respectively type II) as an operator algebra, then the corresponding sub- 
group is of type I (respectively, type II) as a group of MP automorphisms 
of (H,Tr). 


Proof. We have already remarked that the subgroup associated with an 
intermediate subalgebra N is full. Because H is regular in N, by Lemma 6.1, 
the subalgebra associated in turn with this subgroup is the original N. 

On the other hand, consider a full subgroup K of G, and form 
the corresponding subalgebra N—R[U | dv€E K]. We must show that, if 
VEN(H)NN, then ¢y¢ K. To see this, write F = LUB F (¢y, a), and 

aE 


choose a dv in K such that F(¢y,¢7) =F. Then ¢y-y leaves F absolutely 
fixed, and furthermore, for each dw in K, ¢w-y is freely-acting on I—F. 
By Lemma 6.1, this entails Ex(W"V)(I—F)=0. We want to establish that 
F=I. Given e >0, we can choose (by Definition of N) unitaries U,-- +, Un 
with ¢y,€ K and scalars a,,:-+-,a@, such that [V—DaWj] <e It fol- 
lows that [[—F—SaV-U,(I—F)]<e«, or on application of Ey, that 
[l—F— Dd akx(V"0,)(I—F)]<e. Because each Ey(V-"U,)(I—F) 
== 0, this gives [I — F] < «, and it follows that FI. This establishes the 
existence of a 1:1 correspondence. 

Now let N be an intermediate subalgebra, and K the corresponding sub- 
group of G. It is trivial that the center of N coincides with the fixed algebra 
Zx of K. Let P be & non-zero projection in H which is abelian in N in the 
sense of operator theory—that is, PVP C PZr—. Then a fortiori PH C PZx, 
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and.P is abelian over Zg in the measure-theoretic sense. Conversely, if P is 
an abelian projection over Zx in the measure theoretic sense, then we claim 
that P is abelian in N in the operator sense. For this, it suffices to show 
that PUP € PZx, for each U in N(H) ON. Let F=F(dw,e). By Lemma 
6.1, Ey(U) =FU (=UF). Furthermore, by the measure-theoretic definition 
of abelian projections, Péy(P)Hx(U) C PZx, and P(I—F)¢o(PU—F)) 
0 ([3, Lemma 4.1]). It follows that PUP = Poy(P)U = Poo(P)FU 
— Pdy(U) € PZx, proving that P is abelian in N in the operator sense. 

Assume that N is of type I as a von Neumann algebra—namely, that 
each non-zero projection dominates an abelian projection —. We claim that 
K is of type I. If not, there exists a non-zero projection C in Zx such that 
Ko is of type II on CH. Choose an abelian projection P in N with central 
carrier 0. By Maharam’s lemma, since CH is of type II over CZx, there 
exists a projection Q in H with Ezs(Q) = Er,(P). This means that P and 
Q have the same center-valued trace in N, and that they are therefore equi- 
valent mod N. Since equivalence preserves abelian projections, Q is therefore 
an abelian projection <C, a contradiction. 

Assume that N is of type II, in the sense that it contains no abelian 
projections. Then the corresponding K must be of type IJ, for otherwise H 
would contain a projection abelian over Zg. The proposition is proved. 

Assume now that M is type IJ. Then we shall call M approximately 
finite if, for each «> 0 and each finite set X,,---,X, of operators in M, 
there exists a type J subalgebra N of M having the same center Z as M and 
such that [X,— Ey (X)] <<, for all i. (In the terminology of Widom [6], 
this is approximate finiteness (A-2).) 


CorotLary 6.1. If Q is approximately finite, then so ts M. 


Proof. By the regularity of H, it suffices to consider the case X, € N(H), 
t=-1,---,n. Because @ is approximately finite and of type II, given e > 0, we 
can choose a finite freely-acting subgroup K of G such that [I —F([K], &v)] 
<e for allt. Denote by N the intermediate subalgebra corresponding to K. 
By Lemma 6.1, we have [X;—Hy(X,)] = [Z —F([K], ¢x,)]. Therefore, 
we can achieve the desired approximation in a type I intermediate subalgebra. 
It remains of course to achieve the approximation in a type I subalgebra 
having the same center Z as M, and for this, the following assertion contains 
the main technical step. 


(6.5) Let K be a finite freely-acting subgroup of G, let N be the 
intermediate subalgebra corresponding to [K], and let Y,,- - -, Yn be arbitrary 
elements of N. Then, for each «> 0 and each non-zero central projection D, 
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there exists a non-zero central projection CD and a type I subalgebra 
N, of the relative ring Mo having the same center Zo as Mo and such that 
[F0 — Er, (Y) P <e@Tr(C). 

For proof, we shall need the following elementary result concerning group 
extensions. Let ¢ be a homomorphism with abelian kernel mapping a group 
A onto a finite group Q. Then any finite subgroup C of A which is mapped 
- isomorphically into Q by ¢ can be imbedded in a finite subgroup B of A 
which is mapped isomorphically onto Q. 

Applying this result in our present situation with Q =— K, A = > (K), 
and C trivial, we can chose a finite group of unitaries U, in N(H) such that 
$u, = K, for each k in K. Each element of the intermediate subalgebra then 
has a unique representation $, A+Ux (A, in H). In proving (6.5), then, 
it suffices to consider the case Y; = A,U;, (41€ H, k€ K). 

By spectral theory, for each îi, H contains a finite set 9, of mutually 
orthogonal projections such that, for an appropriate linear combination A’; 
of the projections in S, | 4,—A’%|| <</2 (|| denoting the uniform norm). 
Choose a projection P in H such that the kP are mutually orthogonal and 
È kP = I, and let B be the smallest K-invariant Boolean algebra containing 
the projection P and all the sets 9, 8% is then finite, and each of its atoms 
is abelian over the fixed algebra Z, of K. Choose an atom from each K-orbit 
in the set of atoms, denoting the atoms so chosen as Py,::-+,Py. Thus, 


m 
I= X kP, There exist disjoint central projections (,,'  ',C, with 
4-1 à 


> C; =I so that, for each j, the non-zero projections in the set (,P,,---,CyPm 
all have central carrier C;. Choose j such that DC;=40, and then choose a 
non-zero central projection C= DC; such that, if R.,---,R, denote the 
non-zero terms among the C'P,, then all the R; have central carrier C and 
Ez(R1) A: A Es(R,) is bounded away from 0 on ©. Take ê> 0, 8 to be 
specified later. Then, by application of Maharam’s lemma, there exists an 
integer ¢ and mutually orthogonal projections Qo,- ' *, Qı in H such that 
E Qim Rı +: -+ Ee all the Q; have the same expectation relative to Z, 
and for each R,, the sum R’; of those Q4 S R; satisfies Tr (R,— R’;) <8. Now, 
6 is to be chosen so small that an appıopriate linear combination A”; of the 
Qı will satisfy [A”,C—A’,C ] <«(Tr(C) )#/2, for all i. Next, choose an 
automorphism r in Gg which commutes with all elements of K and satisfies 
7(Q:) = Qui (indices mod t), 7t — identity. Let L be the freely-acting finite 
subgroup of Qo generated by r and Ko. Applying the previously-cited result 
on group extensions, we can choose a finite group of unitaries U, in N(H)o 
containing the U, and such that ġo, =z, for each z in D. Let A be the 
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von Neumann subalgebra of M consisting of all operators of the form 
> 0,20, (Ca in Ze). Because the projections tQ, are mutually orthogonal 
wel mae 


and >} zQ. == 0, it is easy to see that the L-invariant elements of A are pre- 

cisely elements of Zo. In turn, let N, be the subalgebra of Mo consisting of 

all operators of the form X A,U, (A, in A). Then the center of N is 
oe 


precisely Zo. Furthermore, it is easy to see that the elements A”,U,,C of N 
satisfy the inequality [LMU 0 —4A”:U C] <<«(Tr(C))% (6.5) follows 
directly. 

By exhaustion, we can express the identity I as.a sum of mutually 
orthogonal central projections C satisfying the conclusion of (6.5). If N; 
denotes the direct sum of the corresponding N,’s, then N, is a type I subalgebra 
of M having center Z and such that [Y;— E,,(Yı)] <e for all i. Applying 
this result to the operators F; == Hy(X4), we obtain [X,— En, (X) ] < 36, 
and the corollary follows. 

Conjecturally, the converse to this corollary—that the group G attached 
to an arbitrary regular MASA in an approximately finite von Neumann 
algebra M is approximately finite—is false. 


Remark 6.1. To conclude, we shall discuss a case, involving the so-called 
group-measure space examples of von Neumann algebras, in which application 
of the foregoing theory to von Neumann algebras is relatively straightforward. 

Given a freely acting group G of MP automorphisms of an (abstract) 
hyperstonian measure space (H,A), there exists a canonical procedure for 
constructing a finite von Neumann algebra—see for example [1, p. 132]—. 
To review details brieflly, one forms the hilbert algebra @ consisting of all 
functions A(g) from G to H, each having finite support, with the product 
(AB) (g) = ZA(h)kLB(h"g)], the adjoint (4(-))*(g) =g (4 (g7)*), and 
the inner product (A,B) = SA(A(A)B(h)*). The left ring £ of Q is then 
a von Neumann algebra with a distinguished faithful normal numerical trace 
Tr, a distinguished regular MASA subalgebra H., and a distinguished group 
G, of unitaries in N(H,) which, with H,, generates £, these having the 
following property: there exists an isomorphism 6 of H on H, such that 
i) Tr(6(A)) =A(A), for all A in H, and ii) the group of MP automorphisms 
of (H,,Tr) induced by @, is precisely the group 6G6*. The full group [G] 
corresponds under 8 to the full group determined by V(H,). 

Carrying this one step further, suppose that M is a von Neumann algebra 
with a faithful normal trace Tr, that H is a MASA in M, and that N(H) 
contains a group of unitaries U, which, with H, generates M, and which 
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induces a freely-acting group of MP automorphisms of (H, Tr). One can 

apply the above construction to obtain a new von Neumann algebra £. Now, 

we assert, £ is isomorphic to M. To see this, let M, be the dense *-subalgebra 

of M consisting of all operators >|A,U,, where A€ H and =Q except for 
9 


finitely many g’s. Under the inner product (A,B) —Tr(B*A), My is a 
hilbert algebra, and M is isomorphic to the left ring of this hilbert algebra. 
We define a mapping from M, to the hilbert algebra @ by sending A € Me to 
the element En(AU,-) of Q. Using the fact that Hy(U,) —0 unless g = 6, 
it is easy to verify that T is a hilbert algebra isomorphism, namely, that it 
conserves products, ädjoints, and norm, and is onto. Therefore, T induces 
an isomorphism of the left rings of these two hilbert algebras, ‚that is, of M 
and Æ. In summary, then, in order that a von Neumann algebra with a 
-faithful normal trace arise from this group-measure space construction, it is 
necessary and sufficient that this algebra contain a MASA subalgebra and a 
group of unitaries in the normalizer of this subalgebra satisfying the conditions 
set down at the beginning of this paragraph. 

Let M be a von Neumann algebra determined in the above manner by a 
freely-acting group @ of MP automorphisms of a hyperstonian measure space. 
Then if @ is abelian (or more generally, if finitely generated subgroups of @ 
satisfy the conditions of Theorem 1), the algebra M will be approximately finite, 
this by Corollary 6.1. This generalizes a well-known result of Murray and 
von Neumann ([4, Lemma 5.2.3, stated without proof]). 
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ON HOMOGENEOUS AFFINE SPACES OF LINEAR ALGEBRAIC . 
j GROUPS.* 


By A. BIALYNICKI-BIRULA.t 


0. Let @ be a linear algebraic group and let H be a closed subgroup of @. 
In this paper we give some necessary and sufficient conditions for G/H to be 
affine. For example, one of our results (Theorem 1) says that if the base 
field is of characteristic 0 and G is fully reducible then G/H is affine if and 
only if H is fully reducible. In the- case where the base field is the field of 
complex numbers the theorem is known (see Theorem 3.5 [3]) but the proof 
presented here is based on a different idea. 

The author would like to express his thanks to G. P. Hochschild for his 
advice in the preparation of this paper. 


1. Let the ground field K be algebraically closed. All algebraic sets, 
algebraic groups and morphisms that we consider are supposed to be defined 
over k. Let G be a connected linear algebraic group. Then k(@) denotes 
the field of all rational functions of G (defined over k) and k[G] denotes the. 
ring of all regular (i.e. representative) functions of @ (defined over k). 
If fek(@) and ge G the left and right translates g-f, f: g are defined by 

(g: F) (2) =f (z9), (Felge). 

For any subgroup H of @, H, H, denote the groups of all left and right 
translations of k(@) by elements of H. 

If H is a closed subgroup of G then G/H denotes the algebraic variety 
of right H-cosets of G. The field of rational functions &(G/H) of G/H is 

“canonically isomorphic to the subfield k(@)#: composed of all functions from 
%(@) that are fixed under H, Moreover, the ring k[G/H] of regular func- 
tions of G/H is canonically isomorphic to k[G]#:+—k[G] Nk(G@)Fı. We 
shall identify k(@/H) with k(@)#: and k[G/H] with k[G]?* according to 
these canonical isomorphisms. The subgroup H is called observable (in G) 
if k[@]7: generates k(G)F: as a field [2]. It is known that H is observable 
if and only if G/H is quasi-affine [2]. The field k(@)#: is stable under G,; 
this action of G on k(@)#: is induced by the transitive action of G on G/H. 


* Received March 6, 1963. 
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Tf fe [oje then (@/H); denotes 2 set of all points ze G/H such that 
f(a) #0. 

Suppose that @ acts as a group of linear automorphisms on some finite | 
dimensional vector space M over k. We shall say that M is a rational finite 
dimensional G-module if the representation of Gin M is rational. M@ denotes 
the subspace of M composed of all elements ve M such that g(v) =v, for 
every gE @. One can prove (see Lemma 2 in [9]) that if @ acts on an 
affine space V then there exists a G-embedding of V onto a closed subset of a 
rational finite dimensional G-module. 


2. We shall say that a subring R of k[@] is G,-simple if it contains k, 
is stable under G, and has no G,-stable ideal other than (0) and R. 


Propostrion 1. Let H be an observable subgroup of G. Then G/H is 
affine if and only if k[G]*: is G,-stmple. 


Proof. I£ G/H is affine then k[@]”: is G,-simple since G/H is a homo- 
geneous (-space. 

Now, assume that k[@]#: is G,-simple. We may find a non-zero function 
fek[@]#: such that (G/H); is affine (since G/H is quasi-affine). Since 
k[G]#: is G,-simple, there exist an integer n, some elements g1,’ °°, gn€ G 
and hy,‘ + *,he€ k[G]# such that Z (F g) u=. We have (G/H)}-9,. 


= 9;1(G/H); Therefore (G/H);.9,°°-,(G/H);-9, form an open and 
affine covering of G/H. Thus @/H is affine (see, e.g., Theorem on p. 05 
in [4]) . 

We can also show that every G,-simple subring R of k[@], such that 
k(@) is separable over the field generated by R, is of the form k[@]#:, for 
some closed subgroup H of G. Indeed, suppose that R satisfies the above con- 
ditions. Then the field generated by R is G,-stable and is of the form k(@)#:, 
for some closed subgroup H of @ (see [1]). Now, k[@]#: contains R and is 
G,-simple (since every f€ k[@]*: can be written as fı/fz, where fı f2€ B). 
By Proposition 1, @/H is therefore affine, and hence k[@]#: is finitely 
generated. Thus we can find a non-zero function he R such that every 
element f € k[@]?' can be written as fı/h”, where fe R and m is a non-negative 
integer. Next, we can find an integer n and elements g,,---,g,€G@ and 
Qu’ * ` ER such that S(h-gi)q—=1, since h40 and R is G,-simple. 
In order to prove that R = k[@]?', it remains to show that k[G]E: C R. Let 
f¢€k[G]#. Then we can choose an integer r and elements hy,‘ -,hn€R 
such that l 


Pe =H, This gives f = = go iei on. 
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But, since I(k-g)g—1, we have (S(h-gi)q)™—=1 and we can find 
gr, © °, Qaf E R such that $ (k: g)Gy*—1. Hence ` 


fof Elh VI 
Thus f€ R. 
The following proposition follows from the above remark and Proposi- 
tion 1. 


Proposition 2. The mapping H>k[G@]F: defines a one-one Galois 
correspondence beiween the family of all closed subgroups H of G such that 
G/H is affine and the family of all G,-simple subrings R of k[@] such that 
k(G) is separable over the field generated by R. In particular, if k is of 
characteristic 0, this is a correspondence between the family of all closed sub- 
groups H of G such that G/H is affine and the family of all G,-stmple sub- 
rings of k[@]. 


3. We assume now that & is of characteristic 0. It is known (see 
Theorem 5.1 in [7]) that 

(i) If H is a fully reducible closed subgroup of G then G/H is affine. 

This result can be proved in the following way. If H is a fully 
reducible subgroup of G then there exists a &[G]?'-linear projection œ: &[G] 
—>k[G]* Hence k[@]#: is G,-simple. Indeed, if f40, fe kG] then 
there exist an integer n, elements g,- - ‚mE @ and fu’ + *,fn€ kG] such 
that S\(f+9s)f:—=1, since k[@] is G,-simple. Hence 


NEAR. 


Moreover, one can show (see Proposition 2.1 in [7]) that H is observable. 
Thus it follows from Proposition 1 that @/H is affine. 

The theorem (i) is a particular case of the following result of D. Mumford 
(see his forthcoming book Geometric Invariant Theory). 

(ii) Let X be an affine algebraic variety and let G be a reductive linear 
algebraic group. Suppose that G acts on V and assume that all orbits are 
closed. Then the orbit variety X/G exists and is affine. 

In the sequel we shall also use the following lemma. 


Lemma 1. Let G be a linear algebraic group and let H,, H, be two 
closed subgroups of G such that H,DH,. If H,/H, is affine then the 
canonical morphism m: G/H,—> G/H, is affine, i.e., there exists a covering 
{Ua} of G/H, by affine open sets such that r+(Ua) is affine, for any a. 
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“Proof. It suffices to find an open affine and non-empty subset U of G/H, 
such that (U) is affine, since. + commutes with the action of @ on G/H, 
and G/H;. Denote by mı, ms the canonical morphisms of @ onto G/Hi, G/H:, 
respectively. Then m, =. Moreover, mı: @>@/H, is- a principal H,- 
fibre space (Proposition 3 in [9]). Hence one can find an open affine subset 
U of G/H, such that U 4 Ø and m, | m (U): 711 (U) > U is isotrivial, i. e., 
there exists an affine variety U’ and an integral morphism p: U’->U such 
that the induced H,-fibre space U’ Xy mı (U) > U’ is trivial (i.e. equivalent 
to the fibre space U’ X H,—> U’ with the natural projection onto U’ and with 
the action of H, defined by h,(u,h) = (u,hh,), for any (u,h) €U’ X H, 
hi € H,). Now, we have the following commutative diagram 


Pr 
U’ Xum (U) —— m (U) 
ate Ta | m (U) 
U’ Xum” (U) sr (U) 


|” ; [1 


U’ ©- — U 
p 

with p’, p:, 7*, #s* induced by p, = |=*(D), ra| m> (U). p is integral 
since p is integral and p’ is induced by p and change of the base variety 

wt(U):~>(U)—>U. Hence it follows from a theorem of Chevalley 
(Theorem on p. 136 in [6]) that if U’ Xyw*(U) is affine then 7*(U) is also 
afne. But U’ Xyri(U) is the H,-orbit space of UX m>(U) =U’ XK H, 
and hence is isomorphic to U’ X H,/H, and thus is affine since U’ and H,/H, 
are affine. l 


COROLLARY 1. Let G, Hı, Hz be as in the lemma. If H,/H, is affine 
and G/H, is affine then also G/H, is affine. 


Proof. It suffices to notice that if + is the canonical morphism 
G/H,— G/H, then, for any affine open subset U C G/Hi, ='(U) is amag 
since ~ is affine. 

Let Gu, Hu denote the maximal unipotent normal subgroups of G and H, 
respectively. (see [8]) l 

Proposition 3. Let G be a linear algebraic group and let H be a closed 
subgroup of G. Then G/H is affine if and only if G/H, is affine. 
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Proof. Suppose that G/H is affine then it follows from Corollary 1 that 
G/H, is also affine. Now, assume that G/H, is affine. The fully reducible 
group H/H, acts on G/H, from the right side and ae is the orbit space. 
Hence it follows from (ii) that G/H is affine. 


COROLLARY 2. If Hu C Gu then G/H is affine. 


Proof. If H, C G, then G,/H, is affine (see e. g., Proposition 2 in [5]). 
Hence, by Corollary 1, G/H, is affine. Thus it follows from Proposition 3 
that @/H is affine. 

We do not know any group-theoretic necessary and sufficient condition on 
G and H for G/H to be affine. One can easily see that the condition given in 
Corollary 2 is not necessary. But such a condition can be found if @ is fully 
reducible. Namely, we have the following result. 


TEOREM 1. Let G be a fully reducible linear algebraic group and let 
H be a closed subgroup of G. Then the following conditions are equivalent 

(a) G/H is affine 

(b) H is fully reducible 


(c) any finite-dimensional rational H-module M is an H-submodule 
of a finite-dimensional rational G-module N such that ME = N@, 


Proof. We have sketched above a proof (b) > (a). (c)> (b). Suppose 
(c). In order to prove that H is fully reducible it suffices to show that, for 
any finite dimensional rational H-module M, M# is a direct summand of M. 
But, this follows from (c) and the fact that @ is fully reducible. 

(b) > (e). If H is fully reducible and M is a finite-dimensional rational 
H-module then M# is a direct summand of M. Let M=M#F-+M,. Since 
H is fully reducible it is observable and there exists a finite dimensional 
rational G-module N, such that M, is an H-submodule of N, ([2]). We may 
assume that N,@—= (0). Now, consider N— M+ N, as a G-module with 
the trivial action of @ on M#. Then N satisfies conditions of (c). 

(a) => (b). In the proof we shall use the following known results 

(iii) (Theorem 10 in [9], cf. also Proposition 14 in [9]). If H, is 
a closed connected and unipotent subgroup of G then the canonical morphism 
wo: G—> G/H, defines a locally trivial principal fibre space with the group Ho. 

(iv) (Proposition lin [5]). If po: V— V, is a locally trivial principal _ 
fibre space with the group Ho, where H, is as in (iii) and V, is affine then the 
fibering is trivial. 
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Suppose (a). It follows from Proposition 3 that G/H, is affine and 
it suffices to prove that H, is fully reducible. Hence we may assume that 
H—H,. By (iii) and (iv) we obtain that G@ is isomorphic to (G/H) XH 
under an isomorphism commuting with right multiplications by elements of 
H (if (a,h) € (G/H) XH and h€ H then we define (a,h)hı— (a,hhı)). 
Hence the isomorphism induces an injective homomorphism # of k[H] into 
k[@]. sends constant functions onto constant functions and commutes with 
elements of H. Since every finite-dimensional rational H-module is iso- 
morphic to a submodule of a direct sum of H-modules k[H], where H acts 
by left translations, hence H satisfies (c). Thus H is fully reducible. 
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ON PRIME J-RINGS WITH UNIFORM ONE-SIDED IDBALS.* 


By Yuzo Urvun. 


0. We denote by 1(A,B) the set of elements ze A such that zB == 0. 
Similarly r(A,B) denotes the set of ze.A with Br=0. 


A ring 9 is called a J-ring if it satisfies the following two conditions: 


(Jı) Ifr(S,A) £0 for a left ideal A of S, there exists a nonzero left 
ideal B of S such that AN B =0. 


(Jr) =the right-left symmetry of (Jı). 


We say that a ring S is a J-ring if it fulfills (Jı). A Jering is defined 
in an obvious way. 

A ring £ is called a left quotient ring (in the sense of R. E. Johnson) 
of a subring R if every nonzero left R-submodule of 8 has a nonzero inter- 
section with R. A right quotient ring is defined similarly. An extension ring 
8 of a ring È is called a two-sided quotient ring of R if S is a left quotient 
ring of R, and also a right quotient ring of R. 

For any Jrring 8 there exists such a left quotient ring 8, that every 
left quotient ring of § has an isomorphic, over 8, image in Š. §, is unique 
up to isomorphism over 9, and is called the maximal left quotient ring of 8. 
Similarly the maximal right quotient ring S, exists for any J,ring 8. In 
case S is a J-ring, it may be shown that S has the maximal two-sided quotient 
ring Sr 

A ring 8 is called a continuous transformation ring if there is a pair 
of dual vector spaces (V, V’) such that © is the ring of continuous linear 
transformations of the vector space V topologized by the V’-topology. This 
concept is right-left symmetrical; that is, -S may be regarded as the ring of 
continuous linear transformations of the vector space V’ topologized by the 
V-topology. (See [2; 886, 7, Chap. IV]). 

A left ideal A of a ring S is called uniform if we have BM (40 for 
any nonzero left ideals B and C such that B,C C A. A uniform right ideal 
is defined similarly. 

The main theorem of this paper is the tag Let S be a prime J-ring 
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with a uniform left ideal and a uniform right ideal. Then 3, is a continuous 
transformation ring. Suppose S; is determined by a pair of dual vector spaces 
(V,¥’). 8; (S, resp.) is the ring of linear transformations of V (V’ resp.). 


1. Lemma 1.1. Let 8 bea ring, and Se a minimal left ideal generated 
by an idempotent e. Let A be a right Ore domain, and suppose that Se D A. 
Then there is an idempotent f such that Se—Sf and FSF D A. 


Proof. Let 04a€A. Then a?540, and eas£0. Hence Sea==Se, and 
so bea=-a for some b. Set f—e+be—ebe. Then f=f?, Sem Sf, and 
acfSf. Let 0342€A. Since A is a right Ore domain, there are a’, a” € A 
such that za’ = ag” 5£0. Now fSf is the endomorphism ring of the S-module 
Sf = Je, and hence it is a division ring. Since a’5£0, a%540, and fa’540. 
Thus we may find an element c such that (fa )c==f. g == gf =— sface = tge 
= ad"c E fS. Therefore s= frf, which shows that A C fSf, as desired. ' 

A left (resp. right) ideal A of a ring S is called large if A has a nonzero 
intersection with every nonzero left (resp. right) ideal of 8. 

If a ring 9 is a left (resp. right) quotient ring of a ring R, then it is 
known that for any element x of S there exists a large left (resp. right) ideal 
A of R such that Au CR (resp. cA C B). 

It is easy to see that the conditions (J;) and (J,) are equivalent to the 
following (J’,) and (J’,) respectively. 


(J'i) r(8,4)==0 for any large left ideal A of 8. 
(J’,) == the right-left symmetry of (J’1). 


Lemma 1.2. Let R be a Jrring, and A a large left ideal of R. Lete 
be an idempotent in a left quotient ring 8 of R, and let vE R. If r= en 
and (Sen A)c=—=0, then 20. 


Proof. It is known and easily seen that (B =) (Se N A) + (S(1 ee) nA) 
is a large left ideal of R. By assumption Bz ==0. Since R is aJı-ring, it 
follows that z= 0, as desired. 


Lemma 1.3. Let S be a two-sided quotient ring of a semiprime J-ring R, 
and let e be an idempotent of 8. Then eSe is a two-sided quotient ring of 
eeN R. eeN R is semiprime. In case R is prime, eeN R is also prime. 


Proof. Let 0>&zEeSe. Then Az C R for some large left ideal A of R. 
(eS NR) (Sen A) C egen R, and moreover 


(e8 N R) (Sen A)e C eges N RAT C 08s R. 
Since 2540, (Se N A)r 0 by Lemma 1.2, and so (Sen A)z(e8 N E) 40 
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by the right-left symmetry of Lemma 1.2, and hence ((SeM A)z(sö$nR))? 
40, which implies that (e8 N R)(SeM A) 0. Therefore eSe is a left 
quotient ring of eSeM R. Similarly ee is a right quotient ring of ese N R. 

Next, we suppose that BC —0 for two ideals B and C of egen R. Then 


Om (eSeNn R)B(eSeN RCD (e8 N R) (Sen R)B (68e N RC. 


Hence -(SeM R)B(eSeN R)C(eS N E) =0 by the semiprimeness of R, and 
so (Sen R)B(eSeNR)C—=0 by the symmetry of Lemma 1.2, whence 
(Sen R)B(eSNnE)(SenE)C=0. By the semiprimeness 


(Sen k)C(SeN R)B(e8 NR) =0, 
and hence (Sen k)C(SenR)B=0 by the symmetry of Lemma 1.2. 


Case 1. Let B=C. Then, since ÈE is semiprime, we have (Sem R)B = 0, 
and therefore B==0 by Lemma 1.2. 


Case 2. Suppose R is prime. Then we have (SeM B)B—0 or (Sen R)C 
== 0, and hence B=0 or C==0 by Lemma 1.2, completing the proof. 


Lemma 1.4 Let S be a J-ring. Then S has the maximal two-sided 
quotient ring Sı. Sı may be regarded as the subring of Š, consisting of 
elements x such that the set of y € S with zy € 8 forms a large right ideal of 8. 


Proof. By [6; Lemma 3.1] the set A of ze 8, such that {y € 3: y€ 9} 
is large is a right quotient ring of 8. Since §,D A D 9, A is a left quotient 
ring of 8, too. Let B be any two-sided quotient ring of 8. Then B may be 
looked upon as a ring between 8, and S. Since {y€ 8: cy¢€ S} is a large 
right ideal of 8 for every z€ B, we have BC A, as desired. 


Remark. Right-left symmetrically we may find a subring C of $,, which 
is the maximal two-sided quotient ring of 8. In view of the following lemma 
C may be identified with the subring of $, in Lemma 1.4. 


Lemma 1.5. Let S be a J-ring, and suppose that both P and Q are the 
maximal two-sided quotient rings of S, then there is an isomorphism, over 8, 
of P and Q. 


Proof.‘ There exists an isomorphism, over S, of P onto a subring of Q. 
Also we may find an isomorphism, over S, of Q onto a subring of P. The 
product of these isomorphisms is an isomorphism of P onto a subring of P. 
Thus, the lemma follows from the following 


Lemma 1.6. Let S be a Jrring, and P a left quotient ring of S. Then 
any homomorphism, over S, of P into itself is the identity mapping. 
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Proof. Let v be a homomorphism, over 8, of P into a subring of P, 
and let s€ P. Then Az C 8 for some large left ideal A of S. Let ac A. 
a(v(x)) == (v(a))(v(z)) —v(ar) ax. Hence A(v(z) —z) —0. Denote 
by B the singular submodule of the left S-module P, that is, the set of y € P 
such that 1(9,y) is a large left ideal. Then v(z)—zeB. Since B is a left 
S-module and B N 8 =0, we may conclude that B=0. Thus, z—v(r), as 
desired. 


2. In this section we always suppose that a ring T is a prime J-ring 
with a uniform left ideal and a uniform right ideal. 

A ring 8 is called a right full linear ring if it is the ring of linear 
transformations of a vector space V over a division ring, V being regarded 
as a right S-module. Similarly, a left full linear ring is defined. 

It is evident from the definitions that §, is prime for any prime J; ring 
8. Thus, in particular 7; is a prime ring. From the assumption that T 
contains a uniform left ideal it follows that 7; has a minimal left ideal. 
Thus, Z, is a primitive ring with nonzero socle, and hence it is a right full 
linear ring by [5; (5.1)]. Similarly, 7, is a left full linear ring. Let f, be 
the maximal two-sided quotient ring of T. We may suppose that 7, D f; 
and T, D 7; by Lemma 1.4. In this section we shall show that 7; is a 
primitive ring with nonzero socle. l 

Let e be a primitive idempotent of 7, Though the following Lemmas 
2.1, 2.2 and 2.8 are essentially the same with [4; 2.1, 2.2], we shall show 
their proofs for the sake of completeness. 


Lemma 2.1. There esiste a primitive idempotent f of T, such that 
(Te AT) (fT, Nn T) 0 and (Den T) N (f NT) £0. 


Proof. I£ (TenT)(fT«NT)—=0 for every primitive idempotent f 
of T, then (TeNT)f/T,—0in 7, Thus, (Ten T)P=0 where P denotes 
the socle of 7,. Therefore, (TeNT)(P MT) —0, contradicting the prime- 
ness of T. This shows that (Ten T) (ff, T) 40 for some primitive idem- 
potent f of T,. By the semiprimeness of T we have (f, N T) (Tien T) 0, 
whence (ff, T) N (Zien T) 0, as desired. 


Lemma 2.2. Let OArEeTeNT uandOAyEfT,NT. Then sy 0. 


Proof. If cy—0, then r(7T,z) N fI, 340. Hence r(7,,2) D fT,, and 
so (ff, T) —0. It follows from this that (yf, Nn T) Tie 0, and 
so 1(7,f7,0T) D> Te, whence (TenT)(ff,NT)—=0, contradicting 
Lemma 2.1. 
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Lemma 2.3. (TenT)Nn (f7,NT)(—A) is an Ore domain. 


Proof. By Lemma 2.2 A has no zero divisors. Let Ope A and 
0 q€A. It follows from the general theory of quotient rings that Tye N T 
is a uniform left ideal of T. Hence (Ten T)pn (Ten T)g>£0, and so 
(hen T)pn (Tien T)q) (ff. T)Æ0 by Lemma 2.2. Since T is semi- 
prime, (FT.NT)((DenT)pn(TenT)g)>0. Thus, 


0 (J.N T) (THAT) PN (fN T) (Te NT)q C Apn Ag 


and hence Ap N Aq-40. Similarly, pAngA>£0. This shows that A is an 
Ore domain, as desired. 


LEMMA 2.4. There exists an idempotent g in T; with the properties 
that (i) gTig is the quotient division ring of A, (ii) Tie == Tig, and (iii) 
fT, == gT, _ 


Proof. Since A is an Ore domain, and A C Tye, there is an idempotent 
g of Ti such that Tig = Tye, gTıg D A by Lemma 1.1. Let K be the quotient 
ring of the Ore domain A. Then, since gTıg is a division ring, we may 
suppose that gTıg > KD A. Thus the identity element of K is g, and hence 
ge. 
On the other hand, there exists an idempotent h of T, such that AT, = fT, 
and AT,h D A by the right-left symmetry of Lemma 1.1. 

T: may be regarded as a subring of f, by Lemma 1.4. We shall show 
that K is contained in the subring 7; of Ty. To see this it is enough to prove 
that for any 054¢¢ K there is a large right ideal C of T such that tO CT. 
Now there exists an element a€ A with O#Atae A. Hence ta(hT,NT) CT. 
Let Ob¢€A. Then bb == g for some VEK CT; We have 


t((1—h) T, N T) = tb'b((1—h) 7, NT) 


in f, However b((I—k)T,NT) CAT,A(1—h)T,—=0 in T,. Therefore 
t((1—h) F.N T)=0 in T, Set C=a(hT, NT) +((1—k)T,NT). Then 
C is a right ideal of T, and tCCT. Now (h7,NT) ON ((1—A)T, NT) 
is a large right ideal of T, and AT,OT is a uniform right ideal of T. 
a(h? NT) CA(AT, AT) C (F(Z AT) Cfl, OT =hū NT. And more- 
over a(hT, T) =a(fT,N T) 40 by Lemma 2.2. Thus, it follows that C 
is also a large right ideal of T, as desired. Therefore K C Ñ; C 1, 

Next, we regard 7; as a subring of 7: K CT, CT, Let b be any 
nonzero element of A. Then g—bbd’ for some b’ € K, since K is the quotient 
division ring of A. 0g, =bbf, Cbt, C (f7,NT)T, C fT, By the 
minimality of fT, we have g, =— fT. 
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KENT cglgAtl C(MgAT)N (gf: NT) C (Pg AT) N (92-7) 
= (en) (FNT) =ACENT. 


Therefore A = gg NT. 


Now we have A CK C gTıg. By Lemma 1.3 gTig is a two-sided quotient 
ring of gT,gNT—A, and therefore gT;g is a two-sided quotient ring of K. 
However K is a division ring, and has no proper quotient rings. Thus, 
K=gT,g, completing the proof. 


Lemma 2.5. T, ts a primitive ring with nonzero socle. 


Proof. From the primeness of T it follows immediately that T, is also 
a prime ring. By [2; Proposition 1, p. 65] Tg is a minimal left ideal of 7; 
since g7,g—=K is a division ring. Therefore 7, is a primitive ring with non- 
zero socle, as desired. ` 


3. Let P be a primitive ring with nonzero socle, and let d be a primitive 
idempotent of P. Then, as is well known, dP is a vector space over dPd, 
and P is a dense ring of linear transformations of the vector space dP. 
Similarly, P is a dense ring of linear transformations of the vector space Pd 
over dPd. The correspondence (z,y)—> zy gives a bilinear transformation 
(dP,Pd)—dPd. (dP,Pd) is a pair of dual vector spaces with respect to 
this bilinear transformation. dP is a topological vector space over dPd by the 
Pd-topology. A subspace of dP is closed if and only if it is the orthogonal 
complement of a subspace of Pd. Similarly Pd is also a topological vector 
. space by the dP-topology. Let X be the ring of continuous linear trans- 
formations of Pd. Then X may be regarded as the ring of continuous linear 
transformations of Pd. X contains P, and the socle of X coincides with that 
of P. (See [2; p. 77]). 

Let Y be the ring of linear transformations of dP. Then Y D ZDP. 
Similarly, the ring Z of linear transformations of Pd contains X. 

In view of [5; (5.1)] Y=—P,; and Z—P,. Moreover, X =P; by 
[5; (5.3)]. 

THEOREM 3.1. Let T be a prime J-ring with a uniform left ideal and 
a uniform right ideal. Then T; is a continuous transformation ring. 

Proof. By virtue of Lemma 2.5 T, is a primitive ring with nonzero 
socle. Set P=, Then it is evident from the general theory of quotient 
tings that ,—T,. Since X = P, T,—=X is a continuous transformation 


ring, as desired. 


Remark. Y=—=P,—T, and Z=P,—T,. 
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A left ideal A of a ring S is called closed if for any left ideal A’ with 
AC A’, A54A’ there exists a nonzero left ideal A” of S such that A” C A’ 
and A” A-==0. (Closed (R. E. Johnson) = complemented (Utumi [5]) 
== complement (Goldie [1])). It is known that the set of closed left ideals 
of a J-ring S forms a complete complemented modular lattice L(8). If g 
is a left quotient ring of a Jrring 8, then 8’ is also a J;ring, and the corres- 
pondence 4 € L(S’) >ANS gives an isomorphism L(9’)—>L(8). A left 
ideal of 5, for a Jıring S is closed if and only if it is generated by an 
idempotent. 

TrworeM 3.2. Let T be a prime J-ring with uniform left ideal and a 
uniform right ideal. Let e be an idempotent in the socle of Ti. Then eT ye 
is a simple ring with minimum condition, and is the classical quotient ring 
of eTe NT. 

Proof. It is evident that eT,e is the total matrix ring of finite degree 
over a division ring. By Lemma 1.8 e:e NT is a prime ring, and eTe is 
a two-sided quotient ring of efjeMT. Since eTye is a J-ring, it is not 
difficult to see that eT,eN T is also a J-ring. In view of the isomorphisms 
between the lattices of closed one-sided ideals of eT;e and eže N T it follows 
that eT,eN T satisfies the maximum conditions for closed one-sided ideals. 
Moreover, since any annihilator one-sided ideal of the J-ring efie NT is 
closed, eT,e N T satisfies the maximum conditions for annihilator one-sided 
ideals too. Therefore eeN T has the classical quotient ring Q by [1; 
Theorem 11],and Q is a simple ring with minimum condition by [1; Theorem ` 
12]. Therefore eT',e may be identified with Q since both Q and efe are the 
maximal (two-sided) quotient ring of eTye, completing the proof. 

The following proposition may be interesting because of the importance 
of the isomorphism between the lattices of closed one-sided ideals. 


Proposition 3.8. Let A bea left ideal of the continuous transformation 

ring X. Then the following conditions are equivalent: 
(i) A ts a finite dimensional element of L(X). 

(ii) -A is generated by an idempotent in the socle of X. 

(iii) A isa left ideal of Z generated by an idempotent in the socle of X. 

(iv) A—YeNX where e is an idempotent in the socle of Y. 

Proof may be easily obtained from the theory of primitive rings, and 
will be omitted. f 


4. Lamma 4.1. Let 8 bearing. Suppose that there ts given a family 
F of subsets of S with the folowing properties: 


4 
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(1) Every nonzero annihilator right ideal contains a member of F. 


(2) If an annihilator right ideal A contains a nonzero element of a 
member M of F, then AD M. 


(8) Each member M of F contains (not necessarily different) elements 
a and b such that 054ab€ M and S8a540. 


Then 9 is a Jrring. 


Proof. Let A be a left ideal of S, and suppose that r(9,4) 340. Then 
AM = 0 for some ME F by (1). By (3) M contains a, b such that 0 s4 ab € M, 
048a. We shall show that AN Sa—0. If not, 04ta€ A for some t. 
Since Aa = 0, ta? ==0, and hence r(S, ta) contains a€ M. Thus, taM == 0 
by (2), and so tab=0. Now r(8,1(S,ab)) contains abe M. Hence 
I(8,ab)M =0 by (2). Since I(S,ab)> t, we have ta =. 0, a contradiction, 
completing the proof. l 


Remark. Let 8 be a ring with a nonzero idempotent in every nonzero 
annihilator right ideal. Then it is evident that S is a Jrring. The set of 
nonzero idempotents satisfies the conditions in Lemma 4.1. 


Lemma 4.2. Let 8 be a semiprime ring, and let F be a family of non- 
zero right ideals satisfying the conditions (1) and (2) in Lemma 4.1. Then 
there extsts a family G of left ideals which satisfies the following conditions: 


(1:*) Every nonzero left ideal contains a member of G. 
(2) Let 0a, bE NEG. Then r(8,a) =r(8,b). 


Proof. Let G be the set of all those left ideals Sx that x is nonzero and 
belongs to a member of F. 

Let A be a nonzero left ideal of S. Then r(8,1(9,A)) is nonzero, and 
contains a member B of F. Hence 1(8,A)B—=0, and so BC1(S,A) 
since B*=40. Thus, 034BA CANB. Let O4ye ANB. Then AD Syé G. 

Next, let 8z € G, 042€ C €F, and let uz be any nonzero element of Sz. 
Evidently r(8, uz) Dr(8,2). If r(S,uz) Ar(S,2), then uzt==0 and ziz£0 
for some t. Hence 042t€ r(S,u) NC, and so r(S,u) DC by (2). Thus, 
uz==0, a contradiction. Therefore r(S, uz) —=r($,2). It follows from this 
that r(8,a) =r(8,b) for any 0544, be Sz. 


Tersonsm 4.3. Let 3 bea semiprime ring. Suppose that there is given 
a family F of right ideals satisfying the conditions (1) and (2) in Lemma 4.1. 
Then 8 is a J-ring. 
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Proof. Evidently F satisfies (3) too. Hence $ is a Jrring by Lemma 
4.1. By Lemma 4.2 there is a family @ of left ideals satisfying (1;*) and 
(23). (1,*) implies the right-left symmetry of (1). It is easy to see that 
(21) is equivalent to the symmetry of (2). The symmetry of (3) is obviously 
fulfilled by G. Thus, by the right-left symmetry of Lemma 4.1 it follows 
that 8 is a Jering, as desired. 


COROLLARY 4.4. Let 3 be a semiprime ring. Suppose that every non- 
zero annihilator right ideal contains a minimal annihilator right ideal. 
Then 8 is a J-ring. 


Proof. The set of minimal annihilator right: ideals satisfies the condi- 
tions (1) and (2) in Lemma 4.1. Hence 9 is a J-ring by Theorem 4.3. 


THBOREM 4.5. Let 8 be a semiprime ring. Suppose that there is given 
a mapping v of the set L of left ideals of S into itself which satisfies the 
following conditions: 

(a) (0) 0. 

(b) ACv(A) andv(A)=v(v(A)) for any AEL. 

(c) v(A)Nv(B) =v0(ANB) for any A, BEL. 

(a) v(Az) Dv(A)z for any AEL and c€ 8. 

We call a left ideal A v-closed tf A= (A). 


(e) Every nonzero annihilator (two-sided) ideal contains a minimal 
nonzero v-closed left ideal. 


Then S is a J-ring. 
Proof. Denote by F” the set of minimal nonzero v-closed left ideals of 8. 


(i) Every nonzero closed left ideal contains a member of W. In fact, 
let A be a nonzero closed left ideal. Then r(8,1(8,4)) — 108, 1(8, 4)) (=B). 
By (e) B contains a member C of K. If CA —0, then ŒC KS, A)r(8, 18, A)) 
== 0, and so O0, a contradiction. Hence CA 40. Let C20 for ze A. 
By (c) v(Cz) Cv(A) =A. Suppose that »(Cz) D D—wv(D) 0. By (c) 
v(CeN D) =v(0r) N D—=Ds540. Hence Grn D540. Set E ={y€0; 
yz€D}. Then E0. By (d) v(E)z C v(Er) c v(D) =D, and also 
v(E) C v(C) =C. Thus, v(#) =F. Since C is minimal, C = F, and hence 
Cz C D, and so v(Cz) C v(D) = D, which shows that v(Cz) € F, as desired. 


(ii) Every annihilator left ideal is v-closed. In fact, any intersection 
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of v-closed left ideals is v-closed by (b) and (c). Hence it is enough to see 
that the left annihilator of an element z is v-closed. Set A=1(8,r). By 
(d) v(A)e C v(Az) =—=v(0) <0, whence A is v-cloged, as desired. 


(iii) Combining (i) and (ii) we obtain that any nonzero annihilator 
left ideal contains a member of F”. If a nonzero annihilator left ideal A has 
a nonzero intersection with BE F, then A is v-closed by (ii), and so ANB 
is-also v-closed. Since B is minimal, ADB. Thus F” satisfies the right-left 
symmetry of the conditions (1) and (2) in Lemma 4.1, and therefore 9 is 
a J-ring by the symmetry of Theorem 4.3. 


5. LetSbead rring. Then it is easily seen that the following three 
conditions for a left ideal A of 9 are equivalent: 
(i) A is uniform. 
e (ii) For any z€ A and any nonzero y€ A there is a large left ideal B 
of 8 such that Bz C 8y. 


(ii) For any ze A and any nonzero y€ A there exists a left ideal B 
such that Be C 8y and r(S,B) —=0. 


A ring 8 is called right faithful if Se =0, ze S imply z—=0. We say 
that a left ideal A of a right faithful ring S is strongly uniform if A satisfies 
the. above condition (iii). A strongly uniform right ideal of a left faithful 
ring is defined symmetrically. i 


THEOREM 5.1. Let 8 be a prime ring. Then the following conditions 
are equivalent: 
(i) Sisa J-ring with a uniform left ideal and a uniform right ideal. 
(li) 8 contains a strongly uniform left ideal and a uniform right ideal. 
(ii) S has a strongly uniform left ideal and a strongly uniform right 


ideal. 


Proof. Every uniform left (right resp.) ideal of a Jr (J, resp.) ring 
is strongly uniform. Every strongly uniform left (right resp.) ideal of a 
right (left resp.) faithful ring is uniform. Hence the theorem directly 
follows from the following lemma which will be shown in the next section. 


Ummm 5.2. If a prime ring S has a strongly uniform left ideal, then 
8 ts a J-ring. 


6. Let 8 be a right faithful ring. We denote by N,(8) or simply N; . 
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the set of left ideals A of 8 such that r (8, A) —0. Thos, Se N,(8). 


write A> B for left ideda A and B of 8 if for any element z€ A we can 
find a left ideal O € N, such that Cz C B. 


Lemma 6.1. A>B>0 implies A->C. 


Proof. Let c€ A. Then Px C B for some PEN, For any peP we 
have a left ideal Q, E N; such that Q,pze C. Set R— 3.0,p. Then Re C O. 
5 peP 


For any nonzero y€ 8 there is p€ P with py 40, and hence qgpy 340 for 


some qE Qp. Since qp€ R, this shows that-R¢€N; Therefore 430, as 
desired. 


We write 4~B if A> B and BDA. Then, By Lemma 6.1 it is easily 
seen that the relation ~ is an equivalence. i 

A left ideal A of 8 is called strongly large if A~ 8. (See [B; (1.6) ], 
where the set of strongly large left ideals is denoted by S4). For any left 
ideal A of 8 we denote by d(A) (==Ag%(A) in [5; p. 6]) the set of elements 
x such that Bz C A for some strongly large left ideal B. Then d(A) is a 
left ideal by [5; (3.1)]. 


Lemma 6.2. Every strongly large left ideal A of 8 belongs to N,(8). 


Proof. Let 0O3>£re.8. Since 8 is right faithful, yz 40 for some y€ 8. 
There exists a left ideal B€ N, with.By C A. Now we can find an element 
be B such that byr>£0. Hence Az contains bys 340, as desired. 


Lemma 6.3. d satisfies the conditions (a), (b), (c) and (d) in 
Theorem 4. 5. , ; 


Proof. If d(0) 32, then Ar=0 for some strongly large left ideal A. 
Hence 2-0 by Lemma 6.2. This shows that d fulfilled (a). (b) follows 
from [5; (3.1) and (3.6)]. (c) and (d) coincide with [5; (8.2) and (3.4)]. 


LEMMA 6.4. Let A-and B be left ideals of S. A~B if and only tf 
d(A)=d(B). 


Proof: Suppose that d~B. Set Ca—{yeS: yz€ B} for any zEA. 
Let z€ 8. Then zze A, O„EN, and Cez C Ce. Hence Cz is strongly large. 
This shows that A C d(B), and so d(A) C d(B). Similarly d(A) D d(B). 
Therefore d(A) = d({B), as desired. 


Lamma 6.5. Let A be a left ideal of 8. Then d(A) is a minimal non- 
zero d-closed left ideal if and only if A is strongly uniform. 
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Proof. Suppose that d(A) is a minimal nonzero d-closed left ideal, and 
let O42, yE A. Then d(A) =d(Sy) since AD Sy 0. Denote by B the 
left ideal generated by z. We have d(A) —d(B), too. Hence d(B) = d(Sy), 
and so B~ Sy by Lemma 6.4. Thus, Ca C Sy for some O € N, which shows 
that A is strongly uniform. 

Conversely, let A be a strongly uniform left ideal. Let 034a€ A. Then 


A> 8a, and hence A~ Sa. Thus d(A)—=d(Sa) by Lemma 6.4. This 
implies that A is a minimal nonzero d-closed left ideal, as desired. 


Proof of Lemma 5.2. We have seen in Lemma 6.3 that d satisfies (a), 
(b), (c) and (d) in Theorem 4.5. Let A be a nonzero annihilator ideal of 8. 
Then, since 8 is prime, d=§. Hence A contains a strongly uniform left 
ideal B by assumption. d(B) is a minimal nonzero d-closed left ideal by 
Lemma 6.5. Therefore d satisfies the condition (e) too. By Theorem 4.5 
8 is a J-ring, completing the proof. 


7. Finally we note the following 


THEOREM 7.1. Let S be a prime ring with a uniform left ideal and a 
uniform right ideal. Then the following conditions are equivalent: 


(i) S ts a J-ring. 
(ii) Every nonzero annihilator left ideal contains a minimal nonzero 
annthilator left ideal. 


Proof. By the right-left symmetry of Corollary 4.4 (ii) implies (1). 


Let $ be a J-ring with a uniform left ideal and a uniform right ideal, 
and let A be an annihilator left ideal 0. As is known any annihilator left 
ideal of a Jrring is closed (in the sense of Section 3). Now the lattice 
L(8;) of closed left ideals of S; is isomorphic to the lattice L(8) of closed 
left ideals of S by the correspondence W (e€ L(5:)) > WS. Hence there 
is Be L(S,) such that BN S==A. Since 8; is a primitive ring with non- 
zero socle, B contains Se with a primitive idempotent e of S: Se is a 
minimal nonzero annihilator left ideal of $,, and hence en S (=C) is also 
~ a minimal nonzero annihilator left ideal of 8 in view of the next lemma. 
Since C C A, this proves the theorem. 


LEMMA 7.2. Let R be a right quotient ring of a Jering S, and D an 
annihilator left ideal of R. Then DNS is an annihalator left ideal of 8. 
In fact, DO S==1(8,7r(8,D)). 


ON PRIME J-RINGS. 595 


Proof. Set E ==r(R, D). Evidently 
DNSCUS,ENS). 


Let sE I(93,E N8). Then EN S Cr(S,c) =r(R,z) N 8, where both # and 
r(E,z) are closed right ideals of R. By virtue of the isomorphism between 
the lattices of closed right ideals of R and 9, it follows that E C r(R, s). 
Hence zel(B,E)\NS—=DNS. This shows that DN S=—1(8,H 8), as 
desired. 

As a consequence of this lemma we obtain the following, which may be 
interesting in connection with [6; (K’,) in Theorem 2.2]. 


Proposition 7.3. Let S be a prime J-ring with a uniform left ideal 
and a uniform right ideal, and let L(S) be the lattice of closed left ideals 
of 8. Then every finite dimensional element of L(S) is an annihilator left 
ideal. 


Proof. If A is finite dimensional in L(8), then ABMS for some 
finite dimensional B in L(8,). B is generated by an idempotent in 3, by 
Proposition 3.3, and hence it is an annihilator left ideal. Therefore A is 
also an annihilator left ideal of S, as desired. 

Another consequence of Lemma 7.2 is the following 


Proposition 7.4. Let R be a two-sided quotient ring of a J-ring 8, 
and denote the lattices of annihilator left ideals of R and S by L*(R) and 
L* (8) respectively. Then the correspondence W (€ L*(R)) > WS gives 
an isomorphism of L*(R) and L* (8). 


Proof. Denote the correspondence by v. v is a mapping of L*(R) 
into L*(9) by Lemma 7.2. Let AE L*(S), and let d=1(8,B). Then 
A=1(R2,B) NS, whence v is onto. Moreover v is one-to-one since it is a 
restriction of the isomorphism between the lattices of closed left ideals of R 
and S, as desired. 


8. It is easy to find a J-ring with a uniform left ideal and with no 
uniform right ideal. In fact, let $ be a left Ore domain, and suppose that 
it is not a right Ore domain. Then 8; is a division ring, the (classical) left 
quotient division ring of 8. S itself is uniform as a left ideal. If 8 contains 
a uniform right ideal, then §; is a primitive ring with nonzero socle by Theorem 
3.1. Since & D 8:5 8, 8; is also a division ring, therefore I I = Sp. 
This implies that 9 is a uniform right ideal of §; in other words, $ is a right 
Ore domain, a contradiction. 
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ON THE INDEX OF ELLIPTIC OPERATORS ON 
CLOSED SURFACES.* + 


By WALTER KOPPELMAN. 


The index of a linear mapping is the difference between the dimension 
of its null space and the codimension of its range. Many results concerning 
the index of linear elliptic operators on two-dimensional domains have been 
known for some time. In a recent article by I. M. Gelfand [12], a systematic 
study of the index of general elliptic problems as a homotopy invariant was 
suggested. Subsequently articles by Volpert, Dynin, and Agranovič [1, 2, 8, 
9, 28, 24] have contributed substantially to the understanding of the nature 
of this problem. The author has recently learned that M. F. Atiyah and 
I. M. Singer have obtained a formula for the index of very general elliptic 
problems on compact manifolds of any dimension. Unfortunately, these 
results are unavailable to him at this time.? l 

The present paper was inspired by two announcements of Volpert [23, 24], 
concerning elliptic problems on the sphere, S?. The second of these contains 
an especially simple formula for the index in terms of the degree of a related 
mapping. In this work, we show that this formula remains valid for any 
closed oriented surface. Furthermore, we make a detailed study of the 
structure of elliptic operators of first order on such a surface. 

For the convenience of the reader, we have included an exposition of 
known results in §§1-3. With slight modifications, these remain valid for 
compact manifolds of arbitrary finite dimension. In §4, we define a homo- 
morphism x, which sends the group of continuous mappings of the cotangent 
sphere bundle 8 of the surface into the general linear group GL(n,C), into 
the additive group of integers. The value of x on a mapping Q: B > GL(n,C) 
of class C@ is just the index of a system of singular integral operators, whose 
symbol is the function @. $5 is devoted to a study of the general structure 
of elliptic operators of first order on closed surfaces. In $6, we define the 
degree 1() of a mapping Q: B —>GL(n, 0). This is just the degree of the 


* Received April 1, 1963. 
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3 Added in proof. The results of Atiyah and Singer have been announced in the 
Bulletin of the American Mathematical Society, vol. 69 (1963), pp. 422-433. 
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mapping B —> U (n) —> U (n)/U (1) defined by the unitary part U of the polar 
decomposition (*@@)4U of Q. Finally, in §7, we show that, after a proper 
selection of the generator of the third homology group, H,(U(n)/U(1);Z), 
the equality x(@) =1(@) is always valid. In particular, one obtains the 
result that the index of an n X n elliptic system of order m (see 81) is equal 
to the degree 1((1) of the mapping Q: B —> GL (n, C) furnished by its charac- 
teristic matrix function @. 

The author is indebted to Professor C. T. Yang for several helpful dis- 
cussions about some of the topological aspects of this paper. 


1. General remarks concerning linear elliptic differential operators. 
We shall be concerned with an nxn system of linear partial differential 
operators on a closed orientable surface 3 of class CO”. Such a system has the 
form 


(1.1) Iu= > Ahani = “Pate -+ lower order terms, 


relative to a local coördinate system (a*,2*) on d. Here Ata ts is an 
nX n matrix, whose entries are the (t:t2: - -tm)-coefficients of given contra- 
variant C@ tensor fields of rank m, in terms of the natural coördinate base. 
The operator acts on n X 1 vector functions u, and its range also consists of 
such functions. 

For a covariant vector with coefficients (£, é) relative to the natural 
coérdinate dual base, we consider the characteristic matrix function 


(1: 2) i a = J Aht tag én" sia Em: 


Clearly, this defines a function on the cotangent bundle of the surface ð. 
The operator (1.1) is said to be elliptic on æ, if, for every point of the 
cotangent bundle which does not belong to the zero cross section, 


(1.3) det @ 0. 


Consequently, an elliptic differential operator provides a mapping of the non- 
zero part of the cotangent bundle into the general linear group, GL (n, C). 


2. The theory of singular integral operators, We shall also consider 
nX n systems of singular integral operators on æ. Let us first discuss a 
single singular integral operator on R?. We consider a function h(z,z2) on 
R? X (R?— {0}) of class C”, with 


(2.1) h(a, Az) =A"h(z,2), for all A> 0, 
and . 
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(2.2) h(a, 2) do ==0. 
|s|=2 
A singular integral operator on L?(R*) then takes the form 


(2.8) (Hf) (e) =at) Him | h(s2—y)iu)ay 


where a(x) is a bounded C?” function on R*, and the limit is taken in terms 
of the norm of L7(R*). According to a theorem of Calderon and Zygmund 
[5, p. 909], 

(2. 4) LAIST O sup A +] h(@2))), 


where C is a constant which is independent of f. 


We now pass to the surface 3. On 3 we consider a partition of unity 
{¢a} of class O”, where the support of ¢a lies in a single coördinate neighbor- 
hood with local coördinates (Tta, 27g). We now consider for each fE C"(3d), 
the norms 


(2. 5) Iflr= (2, È | pat (6/020) F 1°), 


where || || denotes the norm of L?(R?). The completion of C*(d) with 
respect to the norm || |l, will be denoted by L?,(d). It is known that the 
natural map, L?,(d)— L*,,(d) is a compact linear imbedding of L*,(d) 
in 22,,(8) [19]. 


Definition 2.1. An operator R is called a smoothing operator if both E 
and R* are bounded linear transformations of L? (8) into Z*,.,(d3) for 
any integer r, r= 0. (R* is defined relative to L%,(8).) 

Definition 2.2. An operator S on L%,(3) will be called a singular 
integral operator on 2, if l 

(i) for ¢,~eC"(d) with disjoint supports, ¢Sy is a smoothing 
operator, and 

(ii) for each pair ¢,y¢ C° (8) with support in a common coördinate 
system with codrdinates z == (z', 27), py = ¢Hy + R, where H is a Euclidean 
singular integral operator of the form (2.3), while R is a smoothing operator. 


Definition 2.3. The symbol of a singular integral operator S on 3 is 
the function on the contangent bundle of 3 defined by 


o(8) (p Ede) =ale(p)) + him J exp iS ém)h((p),0) dr, 
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where a(z),h(z,n) are the functions which are associated with the operator 
H of part (ii) of the preceding definition, and p lies in the intersection of 
the supports of ¢ and y. l 

It can be shown that o(8) is well-defined [20]. Observe that the symbol - 
is positive homogeneous of degree zero in the £-variables. 

Let 8 denote the cotangent sphere bundle of d. Then each function. of 
the space 0° (8) is the symbol of a singular integral operator 8 on 3 and 
conversely, for each singular integral operator 8 on 3, the restriction of the 
symbol o (8) to @ belongs to C” (8). If Sı, Sa are singular.integral operators 
on 3 and cı, Ca are constants, then o(¢,S, + 082) = c0 (81) + o (8a). Lf 
S is a singular integral operator on 3, such that o(8,)o(S2) —o(S), then 
S-—S,S8, is a smoothing operator. Relative to a fixed Riemannian metric 
on ð of class C”, we form the Hilbert space Z*(3) defined by the volume 
element of the metric. If S is a singular integral operator on 3, then $*, 
the adjoint of 8 relative to L*(d), is also a singular integral operator on 3, 
and o(S*)==c(S). Finally, we note that for every function FEC*(8), 
it is possible to construct a singular integral operator Sr, whose norm satisfies 


(2.6) [Sr|SC( 2 sup|DeF]), 
jplS2-dimg . 


where C is independent of F. (The reader should have no difficulty in giving 
& proper interpretation to the right side of (2.6).) [20]. 

In terms of the Riemannian metric on 3, we consider the harmonic 
operator A and its extension to the space L?,(3) in the usual manner. This 
extension, which we still denote by A, is self-adjoint relative to the Hilbert 
space L?(3). For a suitable positive constant c, it is possible to show [20] 
- that 
(2.7) (c-1—A)i= (c-1—A)J 


where J is a smoothing operator which commutes with (c-1—A) and for 
which the identity ` 


(2.8) J= (c 1— A) 


holds. From these formulae, we see that (c: 1— A)? is a bounded mapping 
of L?,(3) into L*,,(3). The mapping J is a two-sided inverse. Hence 
(ce-1—A)i is a topological isomorphism of L%,(3) onto L*,,(3). 

If Va: > e, Vm are given C” vector fields on 3, then 
(2.9) vv; 4 Vm = 8 (0: 1—A)”}, 


where S is a singular integral operator on 3, with the symbol 
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(2.10) Ä (HOT ntl El 


Here < > gives the pairing of the tangent and cotangent vectors of 3 into 
the field of real numbers [20]. 
If we consider a single differential operator 


anu 


zs Y ghts te _ I _ 
2.1) Ins=Sa jrun... gair 


-+ terms of lower order, 


on 8, then we can write L= $ aL by means of our partition of unity. 
ota then a product of m vector fields. In 
fact, consider a function ya € C” (8), whose values are equal to 1 in a neigh- 
borhood of the support of ¢a, but whose support lies in the coördinate 
neighborhood associated with ġe. Then we can take 

a ð 


l 8 
Vim daahi tm pat? V: — ya ach? Br Vin = Yar 


Each operator patti” tm 


Of course, 
(2. 12) Vi é/| £ [> = pagi tng,/| é = k +, Vin, €/| é [> = yakin /| € | 


and 


= du 
(2. 18) Viv: 8, is Vint oe hat: tm Ban - date . 
The corresponding singular integral operator Sat,- has the symbol 
(2.14) © (8) haat ing E/T EL 


We now set Sa = Day main, and S = S Ge. Then 
a 
dab —Sa(c1— A)? 


involves only terms of order less than m. These clearly give a compact 
mapping of L*,,(3) into L*,(3). Consequently 


(2.15) . L—8(c:1— A)"/2 
is a compact mapping of L*,,(3) into L*,(3). 
Let us now turn to the discussion of systems. Suppose that L is the 


linear operator of the expression (1.1). The operator L may then be written 
as a matrix of differential operators 


(2.16) Lm (Ly) b j= 1, '„?%, 
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so that Lu = (3 Lat), +=1,:-:-+,n. We assume that the order of L is m. 
Ja 


This means that the order of each Ly is less than or equal to m. By applying 
the preceding discussion to the m-th order terms of the operators Ly, we see 
that 


(2.17) Ly = Sy(c 1— A)" 4 Ky, 


where Ky is a compact linear mapping of L?,(3) into L3% (8). We set 


(2.18) 8 = (Sy), K = (Ky), j= 1, m, 
(2.19) A= (èy (c: 1—A)$), i, j= 1, 7 yt, 
so that 

(2.20) L=8A” 4K. 


For the vector function u == (w), #=1,' : ',n, we introduce the norms 


(2.21) ul = 3 (I, 


and we speak of the corresponding spaces L?,,(3). Thus K is a compact 
linear mapping of L?n,(3) into L*,,(3), while the diagonal operator Am 
is a topological isomorphism of L’m,(3) onto L%on(3). 

A system S = (Si), t, j= 1,: : +,n of singular integral operators is said 
to be elliptic on J, if the nX n matrix of symbols, (8) — (o(Sy)), which 
we shall call the symbol of S, is non-singular at every point of the cotangent 
sphere bundle 8 of 3. It is quite clear that, if L is an elliptic system of 
differential operators, then the corresponding system 8 of singular integral 
operators in the construction above, will also be elliptic. 

The Hilbert space 7?(3), which is formed through the volume element 
of the Riemannian metric, is topologically equivalent to the space L*,(d). 
For n X 1 vector functions u = (w), v = (u), i= 1,: - -,n, we consider the 
scalar product 


(2. 22) . (U,V) n= X (tu; %), 

1 
where (w,%) is the scalar product in L?(3). We thus obtain a Hilbert 
space L?,,(3) which is topologically equivalent to L*,,(3). If S is an 
n Xn system of singular integral operators, then we have 


nn an 
(Su, V)n = 5 > (Sits, vi) = = >= (u, 8yj*0;) = (u, S*v) 9. 
4=1 jal j=l 4-1 
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We have previously noted that S,* is a singular integral operator with 
o(Sy*) —=o(8y). Consequently, if o(S) is the symbol of the system S, 
then o(§*) = *o(8). Thus, if 8 is elliptic, then S* is also elliptic. 

Calderon and Zygmund [4] have shown that if H is a Euclidean singular 
integral operator with constant coefficients, i.e., the functions a(x), h(s, 2) 
in (2.1)-(2.3) are independent of z, then the representation of the operator 
H after a Fourier transformation of L*(R*) is given by 


(2.28) (Bf) (6 =o (E) (8) i, 


where o(H) is the symbol of H. This functional calculus together with the 
estimate (2.4) enables one to show that if 8 is an elliptic system of singular 
integral operators on 3, then an estimate of the form 


(2. 24) It Jan Cl SAU lon + ll % lon) 


is valid for all ve L*,,(3) [2,8]. The constant O does not depend on u. 
Hence, on the null space of SA*, which is a closed linear subspace of L*,,(3), 
we have the estimate 


(2. 25) lu lza SC | 4 lon SC | u [am 


It follows that the unit sphere of the null space of SA? is compact, so that 
the space is of finite dimension [7, p. 245]. Consequently we also see that 


(2. 26) dim ker § <o. 


Since 8* is also elliptic in the present case, we have dimkerS* <œ. Next, 
for those u€ L*,,(3) which satisfy (u,ker JA?)„ 0, one can obtain the 
estimate [cf. 17] 

(2. 27) [u lens 0” || SA®u fon. 


From (2.27) it follows that the range of SA? is closed. Consequently the 
range of 9 is closed. The orthogonal complement of the range of 8 is just 
the kernel of S*. This orthogonal complement is then of finite dimension. 
Since the range of S is closed while both the kernel and the cokernel of S are 
of finite dimension, we see that an elliptic system of singular integral operators 
furnishes a -operator on the space L*,,(3). [13] 


3. Remarks concerning the index. Let B,, B, be two Banach spaces 
and let L: B,—>B, be a bounded linear operator which is also a ®-operator, 
i.e., L has a closed range and the spaces ker L, B,/LB,, are of finite dimension. 
The index of the operator L is the integer 
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(3.1) _ ind L= dim ker L — dim B,/DB,. 
The following results are known [13]. 


THEOREM 3.1. If K is a compact linear operator from B, inio B,, 
while L is a &-operator, then L + K is a &-operator, and : 


ind(L +E) = ind L. 


THEOREM 8.2. For a given ®-operator L, there exists a positive number 
pr, such that for every bounded linear operator M : Bı—> B, of norm || M | < pr, 
the operator L-4- M is a &-operator, and 


ind(L + M) =ind L. 


THEOREM 3.3. If Lu, L, are bounded -operators on a Banach space B, 
then LıLı is a bounded ®-operator on B, and 


ind (LL) = ind L; -+ ind La. 


From these theorems, the decomposition (2.20) and the remarks after 
(2.21), it follows that if L is the operator corresponding to an n X n elliptic 
system, while $ is the elliptic system of singular integral operators as in 
(2.20), then 
(5.2) ind L = ind 8. 


If $,, Sa are elliptic singular systems with o(8:) ==o(S,), then the 
discussion following Definition 2.3 shows that 8, — 9, is a smoothing operator 
(bence compact), so that 


(8.3) ind S, = ind 8, - 

By combining the preceding result with (2.6) and Theorem 3.2, we see 
that if $ is an elliptic singular system, then there exists a positive number ps, 
such that for any singular system M with 

È sup | D?o(M)| < ps, 
lls. 
8+ M is elliptic, and 
(3. 4) ind(S + M) —ind 8. 

R. T. Seeley [21] has shown that if 9 is a single elliptic singular operator 
(with n—1), then , 

(3.5) ind § == 0. 
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4, The index as a homotopy invariant. Corresponding to each con- 
tinuous mapping 
(4.1) d:8>GL(n,C) 


of the cotangent sphere bundle 8 into the general linear group GL(n,C), 
we shall consider an integer x(@) defined as follows. Suppose that the 
mapping @ is homotopic to a mapping 

F:8—>GL(n,C) 
of class C”. Then, according to the discussion after Definition 2.3, F == o (8), 
for an elliptic singular system S on 3. We set 
(4.2) x(Z) =ind 8. 
In order to show that « is well-defined, we must show that if F” is another 
C° mapping, with @—F’=o(8’), then ind S —=ind S. Certainly we have 
FF’. This means that there is a mapping 
(4.3) F;: 8XI->GL(n,C), (I= [0,1]) 
such that Po == F, F, == F. Let us select a sequence of points 

=h Lha <t, =], 


such that Fian = F,,e%, where Qy is a continuous matrix-valued function on 
8. Next, for each k540,», we select C” mappings 


Gr: B — GL(n,C), 
such that Gen Gre®, G= Fe, F —G,,e%4, All Ry will be of class 


C”. Then, 
(4. 4) FP" wm FgRoghi- - - gRr, 


Observe that for each k, e%, 0 = ¢<1, provides a smooth homotopy between 
ef and the constant mapping 1. Hence, according to the remarks leading 
to (3.4), x(e%*) =0. By Theorem 3.3, 


(4.5) (I) =x (Fegi. - - gr) x (F) +x (oF) NH: 


Consequently x(Q@) is well-defined and depends only on the homotopy class 
of the mapping @. Further, if @:~F, @.~G, where F, G are 0°” 
mappings, and if 

(4. 6) Oil: 8> GL(n, C) 


or 
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is the mapping defined by matrix multiplication, then we clearly have 
QQ: ~ FG, and 

(4.7) (Qa) =x (FG) =x(F) + «(@) =«(Gi) + «(83). 


5. The structure of first order elliptic operators on closed surfaces. 
A. The existence of operators. 


The local form of a first order operator is, of course, 
ou du l 
l1 2 
(5.1) A ia +A at -+ lower order terms. 


The ellipticity condition states that 


(5.2) det (Até, + Af) 40 for (6)? + (2)? 0. 


In particular, det A1340, j—1,2. We shall be especially interested in the 
roots A of the equation 


(5.3) det( A!— 142) ==0. 


Under the hypothesis of elliptieity, these roots can never be real. Further, 
because det A*540, (5.3) is equivalent to 


(5. 4) det (A —2-1) = 0, 
where A = (A®)-1A1, 


On our closed oriented surface 3, we now select an arbitrary conformal 
structure which is compatible with the C@ structure on Æ and its orienta- 
tion [3,6]. This conformal structure will remain fixed during the rest of 
the discussion. We now consider a small neighborhood D on 23, which is 
conformally equivalent to a disc. On D, we introduce a local uniformizer 
|z| <1. We denote by Dp the region corresponding to |z] < p, where 
0<p<1l. On D— Dp, we introduce the local uniformizer == 1/z. Then 
at/dg == — 27, and 
(5.5) 2 [arg ]5,——2, 
where the boundary D, of D, is assumed to have positive orientation relative 
to Dp. We suppose that we have a first order elliptic operator defined on 
3—D,. With f= Ep if, z= g! io’, and 
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(this is just the transformation law for A = (A*)-*A1, when the Cauchy- 
Riemann equations are used), we now prove 


Lemma 5.1. [argdet 4]5,—=0. 


Proof. If ee - + Àn denote the eigenvalues of A, then 
n A 
det Â = II Ay 
f= 


The eigenvalues are continuous on Dy; and never real. Hence [arg Â;] 5p "= 0, 
and 
n 
[arg det A], —2 [arg âj] b, = 0. 
Lemma 5.2. Let the matriz A possess P eigenvalues with positive 
imaginary part, N eigenvalues with negative imaginary part. Then 
i dx} „der, l 
ler det (A a +1 ga ) l=? (P—N). 
Proof. Let Ay,‘ + *,An denote the a of A. Then 


sp Oe 


xt 
det(A zr +1 ore H ugg + ge) 


The linear homotopies 


er . ĝe | dat 
(1-1) (ua + ag), + Yen (ad) oe Fa) SiS, 
all involve quantities with non-vanishing imaginary parts. Hence 
6 jet 5 o ðr ĝe 
[arg (yer + Ger) oom Lang (ego (Ima) “6 OE + en 
lee Ge —é- sgn (Im) 2% a lin 


ĝe „dat. de 
However, JE te ar By applying (5.5), we obtain 








1 2 [arg det(4 75 +1: a 


S 4È pa eas sa mapt lb, 


Bon [arg 1,2 (PN). 
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Lemma 5.3. Let T be a non-singular matrix, for which 


C, 3 
-t ee 
T ar=(6 0)’ 


where all of the eigenvalues of C, have positive imaginary part, while all of 
the eigenvalues of C, have negative imaginary part. Let df be a complex 
cotangent vector. Then, the expression 


rer u) ge) 
is conformally invariant. 
Proof. Set Mm aE, so that 
J 
Aj en, 
With dmg, 


> 8 lp 0 ¢-lp 0 
jar ir (o =i ( 0 A 


gé E) f 
~r tae) lp 0 pip 
—jor+ar(? a (5 aa a 
Zu 0 (+ Ir 0 $’ ix 
f org or yil oie, gape ON (beter _0 
| erg HETE Hi, aE + aril) eee i ae ae 


eee. el 0 
jar iaer( Ss a 


(We have used the Cauchy-Riemann equations to obtain the last expression.) 


Lemma 5.4. If pdt is a regular analytic, non-vanishing differential on 
3 — Dp and the genus of 3 is p, then 


= [arg 615, = 2p. 


Proof. Let gåt — Fat, where G is Green’s function of d — Dp [cf. 18]. 


3—D, is a surface of genus p with one boundary component. Its double 
[18] is of genus 2p. The differential gd£ may be extended to the double by 
means of the Schwarz reflection principle. On the double it represents a 
divisor of order 4p— 2. On the boundary of d-— Dp it is regular and does 
not vanish. Hence on 3—Dp, gd£ represents a divisor of order 2p—1. 
Further, 
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larg oe, 0, + [arg a Jip=—1. 


Lterge Ho, — Llarg 6/glö, + largo Js, 
= 2 [arg $/9]5,.—= 2p—1. | 
Therefore, „[argsl,=2p—1— 4 [arg 1, = 2p. 
Lemma 5.5. = [arg det A*]5, = + [arg det A*] 5, = (2— 2p) (P—N). 
Proof. We have A! A424, hence 
[arg det A*]5, — [arg det A*];, + [arg det Â] dp 
According to Lemma 5.1, [arg det 4]5,==0, so that 
[arg det A J3, — [arg det 4,]5,. 
Next, we observe that 


ĝa! dx! da! Ga 
Dg Aa Ue 2 T 0.48% Ye: pe 
Â= A ja +A je A (A JE +1 ja) 
Thus 
= [arg det A*] 5, — I [arg det A*]p, 
dx Bat 
+ „lang det (Az + 1-5) lop 
By Lemma 5.2, 


bat 
4 [arg det(A Et 1- ja) lap =2(P—N). 


With T locally defined as in Lemma 5.3, (cf. §5.B, (5.10) ) 


TAT +, 9 ) 


— İy 


= Pear (Dar +i( 9 )) 
eee 


— T-ı42 1 
- A r( 0 i AG) 


Hence, 
[arg det(T-2A27 + mary ee: ls, 


= [arg det A°] >, + [arg det (C, +i'1p)]5, + [arg det (0: —;- ivlo»- 
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However, if Ay,’ © `, Àp represent the eigenvalues of Cx, pu’ ' "Am the eigen- 
values of Cz, we have ImA;>0, Imp, < 0, and 


[arg det (Ci + 4-1) l5 => farg (Ay + #) 15, —0 


[ang det(C.—i ty) J, = È [erg (m —i) lip 0. 
Thus i 
[arg det 4°]5, — [arg det{T+4T + er) ER 1.) isz 
Incidentally, 
det{T-+A1T +4TA°T) 


Ciit lp 0 
= S 2 * 
det (TAT) det ( 0 ER g) 


P N 
== (det A?) II (4 +3) I (a —*) 
gal k=l 
has a value which does not depend on the normalizing matrix T. 
With T locally defined, and dt as in Lemma 5.4, we must have 


; 1 0 “I 0 A 
[ang det Ar Hirer (7 aa P PAAD 


along the boundary A of a small triangle A on — Dp. Using the conformal 
invariance established in Lemma 5.3, and a sufficiently fine triangulation of 
3 — Dp (however, see the discussion of §5.B after (5.11)), we obtain 


BEN -1 41 -1 42 Ip 0 pip 0 . 
0 = [argdet{ TAT + iT ery ik 0 ZT 


— [arg det{ TAT + TAT (5 BR + Plarg ¢]b,—N [arg dl». 
By Lemma 5.4, {[arg pld, = 2p. Hence, 
$ 1 0 : 
2 [arg det {TAT + er ( ER is ) Yo, = 2 [arg det A], —— 2p(P—N), 


and 
„ [arg det £t] g, = (2— 2p) (P—N). 


As a consequence of Lemma 5.5, we immediately have 


THEOREM 5.1. For a given first order elliptic operator defined on a 
closed orientable surface of genus p41, P =N. 
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On the torus, however, one can actually construct first order alliptic 
operators where P and N are arbitrary. 


B. The principal fiber bundle associated with an operator. 


With every given elliptic operator of first order on the surface 3, we 
shall associate a principal fibre bundle with structural group GL(P,0). 
In order to define this bundle, we consider the matrix A = (A?)-14!, At 
each point of 3, we now consider all non-singular matrices T, for which 


(6.9) TAT = -(¢ a 
` 2 

as in Lemma 5.3. If we write 

(5.8) T-(T,T,), 


where T, is an n X P matrix, T} an'n X N matrix, we see that the columns 
of T, form a basis for the space spanned by the eigenvectors of A corres- 
ponding to eigenvalues with positive imaginary. part, while the columns of 
T, form a basis for the space. spanned by the eigenvectors corresponding to 
eigenvalues with negative imaginary pari Observe that under a change of 
local codrdinates, - 


Oa Da act | | Bat 
(5.9) 7 kan (—Ajatl ve) (dat! jE )> 
while 
TAT 


T (— 0 gt ie we (Og tte: ie) 0 


Q (— Cass td A (04 je tie 5) 


la 


-1 Sen Poren k at 
The matrix (— Ong Ip: JE ) (E1 =) has the eigenvalues 


dx" a1 , da ; 
(— va je) Mag T pa)» j=1l, g PD 
(We use the notation of Lemma 5.5.) Furthermore, 


“Asha OE + Oat OE" __ (Aga /08* + 0/0) (Art /0E* + 827/82) 
AbT [Or + 80/08 | — Aydt /8E* + 00° /08 |* 





But the imaginary part of the numerator in the last expression is 


aman) +(Bh>e 
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In the same way, we see that the eigenvalues 


phe 0E + Oat fO iN 
er 8 2 
of the corresponding N X N matrix have negative imaginary part. Therefore 
TAT also has the required normal form. Consequently, the vector spaces 
spanned by the columns of 7, T, are indeed defined quite independently of 
the local coördinate system. The columns of T, can, for example, be obtained 
. by considering the projection 


(5.10) x= ai A), 


where the contour of integration surrounds all eigenvalues in the upper half- 
plane and no others. The columns of x span the space spanned by the eigen- 
vectors corresponding to eigenvalues with positive imaginary part. Formula 
(5.10) shows further that if a certain set of columns of x forms a basis for 
this space at a point of J, then this same set of columns yields a basis for 
the corresponding spaces at neighboring points. Thus, locally, we may choose 
a smooth set of bases. l 

Assume now that we have an open covering {Ua} of 3, such that in Ua, 
the nX P matrix function Ty, is of class O*. If Ua N UgQ, then we 
have the two functions Ta and T',,a defined in the intersection. Of course, 
T,,«.gag = T 1,8, where gag-is a uniquely determined non-singular P X P matrix. 
The matrix geg is again of class O” in Ua N Ug. The functions gag serve as 
transition functions for a fiber bundle, since for Ua N Ug N Uy Ø, 





Tagay == Ts,89 67 = Tr a9ap9 py, 
80 that gay == gapgpr- 


Of course, at a point of Ua, an arbitrary T, may be obtained from To 
by means of a uniquely defined element ga E€ GL(P,C), so that Traga = Tx. - 
If the point in question lies in Ua N Ug, then also T,98—T:. But Tipgp 
‘== Ty agapgp, 80 that ga==9gapgs. We therefore use the group GL(P,C) as 
typical fiber, where GL(P,C) acts on itself from the left. By means of the 
standard construction [22, p. 14], we obtain a principal fiber bundle over 2, 
with structural group GL(P,C). This will be the principal fiber bundle 
which we associate with the first order differential operator. 

We now make an observation. We could have constructed, in the same 
way, a principal fiber bundle over 3 with structural group GL(N,C). We 
shall show that these two principal fiber bundles are related. In fact, the 
first Chern class of the second bundle is simply the negative of the first 
Chern class of the first bundle. 
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In order to arrive at this result, we begin with the following analysis. 
Let us triangulate the surface ð by means of triangles {Aa}. In each Aa, 
we choose smooth matrices Tia and Tsa. We now give each of the 1-simplices 
of our triangulation an arbitrary, but fixed orientation. Each 1-simplex is in 
incidence with two 2-simplices. Call the left 2-simplex A, and the right 
2-simplex Ar. We now compute the number 


(5. 11) y am = I [arg det TTI, 


where the summation is extended over all 1-simplices. This number is called 
the characteristic of the first order elliptic operator [23]. 

We observe that a much simpler expression for can be obtained if we 
take advantage of the surface d—-Dp. If we restrict our first bundle to 
2 —- Dp, then it has a cross section and thus is trivial. This follows from 
the fact that the second cohomology group of 3 — Dp is trivial, so that the 
obstruction cocycle [22] of the restriction of our bundle to 3d — Dp vanishes. 
Consequently, we have a cross section which has the local representation {ga}, 
with gg==gpaga. Thus, if we set W«=T',,«ga, then 


Wp = T1298 = Tı,89829a = T1,09a = Wa, 


i.e, we may define Ty == We in Ua, so that Ty is continuously defined on 
3—-D,. Similarly, we may define T,* over Dp. (In fact, Dp is contractible 
[22].) On Dp, Tr = Tig, and : 
(5. 12) == Pa [arg det ‘TT |b 
On the other hand, 

PT aes TT +g. 
The matrix '?,*T,* is Hermitian and non-singular. (In fact, this is just the 


Gram matrix of the column vectors of T,*.) Thus det!T,*T, is always real 
and non-zero. Consequently 


(5.18) o = 2 [arg det g] op 


w is then just the value of the obstruction cocycle of the first bundle on the 
fundamental cycle of 3. The cohomology class represented by the obstruction 
cocycle is the first Chern.clase of the bundle [14, 22]. l 

A similar construction for the second bundle yields Ty == Tth on Dp. 


Hence i 
(5.14) t=T) Ts 5). 
Now 
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(5.15) [arg det 7*7-]5,— [arg det T-]5, — [arg det T*]a, 
00-0. 
(The result for T- is obtained from a triangulation of d—D..) But 
(5.16) PT- =T D , 
so that 
(5.17) [arg det?7*T"]5, = [arg det ‘T+T*] 5, + [arg det g]ö, + [arg det hla, 
On the other hand, 
[arg det *7*7*]5, = [arg det T*]5, — [arg det T* lbp = 0. 
(5.15) and (6.17) therefore yield 
(5.18) [arg det glo, + [arg det hla, = 0. 
This proves our assertion about the Chern classes. 


C. Special operators of arbitrary characteristic. 

In this section we construct special first order elliptic operators of arbi- 
trary characteristic ©. Since we are interested primarily in examples with 
non-zero characteristic, we assume that 0< P <n. We begin with the special 
matrix 


.flp 0 
(5.19) | :( BR . 
On 3 — Dp, we choose l 
(lp 0 (lr ae 
(5.20) aif 2 T, e tr=(?), 


so that T- is the nX n unit matrix. On Dp, we choose as boundary values 
for Tt, the matrix 


(5.21) T= 1 ; 
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so that 
ze 0 0 0 
(5.22) Tr=-/0 Ip], Tit=[ 2 0 
0 0 0 lya 
On Dp, det T* == 1, so that 
(5.23) [arg det T+], =0. 


Hence T* possesses a continuation into. the interior of Dp, with det T* +40 
everywhere. (The argument of Steenrod [22, p. 25] allows one to construct 
a continuation of class.C”.) Further, T,*=Tyrg., Ta = Tyga on Dp, with 


2 0 “o 0 
(5. 24) n= ony a—(5 ae 
We now define 
(5.25) e a a Je: 
0 —Ir 


on Dp. This gives a continuation of A onto all of d. On 3—D,, the 
operator 


u u fòir 0 \ wu | ow 
0:29) tal a) æ 2 


thus yields a system of N Cauchy-Riemann operators and P conjugate Cauchy- 
Riemann operators. We now consider a non-vanishing differential dd£ on 
3 —Dp, and we form the elliptic system 


+ tee? Vere us 4, fu 
6.9) (P7 pou) Uet 22000 227 
relative to local coördinate systems on d—D,. We observe that on Dp, 
we have, according to Lemma 5.5, 
z [arg det 4], = (2—2p)(P—N), j=1,2. 
If (2— 2p) (P—N) =0, the matrix A? may be continued as a non-singular 
matrix into Dp. We then set At A*d in Dp, where A is defined through 
(5.25). (Note that 4 =A on D— Dp in our special situation.) Thus we 
have constructed an elliptic system on 3, for which 
[arg det *T,*T,-]5. = [arg det (g:)-*] 5, — ro. 

The characteristic of the system, therefore, is w. 

D. The index of a spectal operator. 

We now consider a special equation of characteristic w, 
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ou 
dr 


After changing the dependent variables u, so that 


(5.28) Iu=A At 


Tu in 3 —D 
(5.29) um Ira in De P 
we have 
(5.30) gu=i(t Ze a PE + lower order terms 
on T (43) 7, 
with 
(5.31) T+wt = T-w- on Dp. 


With our special choices for T*, these boundary conditions are simply 
(5.32) Wi = ZPW, Wey =Z Wp, wp =w, j1, P41. 


The range of the operator £ in (5.30) consists of nX 1 vectors v, whose 
components are coefficients of forms of type (1,0) or (0,1). This follows 
from the transformation law for A'T in our special situation. In fact, 


vıdz,* + °, Updz, Vpđž,* + *,V„dē are conformally invariant. 


We now consider the Hilbert space H,,(3) which is the completion of the 
piecewise smooth C*, n X 1 vectors w on 3 which satisfy (5.31), relative to 
the norm || lın. The operator £ can then be viewed as a bounded operator 
of the space H,„(3) into the Hilbert space Hon(3) of square integrable 
vectors v described above [cf. 16]. We denote by £, that operator which 
arises from £ by discarding the lower order terms in (5.30). $£, is then 
also a bounded linear transformation from Hin(d) into Hon(d), which 
differs from £ only by a compact linear transformation. Further, a coercive 
inequality of the form l 


(5.33) | fun SC (|| Low lon + | % lon) 


may be derived for all we H,„(3) [16]. Actually, £o is a -operator whose 
index may be computed by means of the Riemann-Roch theorem [16]. (This 
follows from the nature of the boundary conditions (5.32), which allow one 
to compute the index by discussing analytic functions on 3, which are mul- 
tiples of a certain divisor.) This index is given by 


(5. 34) —Ratn(l—p). 
Of course, by Theorem 3.1, the index of £ is also given by (5.34). 
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Next, we observe that (5.29) establishes a 1-1 correspondence between 
piecewise smooth O” functions u which satisfy 


(5.35) w—u on Dp, 


and piecewise smooth C°” function w which satisfy (5.31). Because of (5.35), 
it is easily seen that for any test vector ¢ of class O”, with support contained 
in a coördinate neighborhood of 3, 


(5. 36) fu, de = — f (*u) a de. 


Because of the identity of strong and weak derivatives [11], it follows that 
such a function u belongs to L?,„(3). On the other hand, every vector 
function u which is of class C° on all of 8, certainly satisfies (5.35). 
Further, these C” function are dense in L?,,,(3). Consequently L*,,,(3) is 
the completion with respect to the norm || lın of the space of piecewise 
smooth functions u which satisfy (5.35). In view of (5.29), one can derive 
inequalities 

(5.37) o OF fw lie S |e ia SC | wn 


for corresponding piecewise smooth functions u and w.. (The constant C 
does not depend on u and w.) From this discussion it follows that the spaces 
Hin(3) and L*;.(3) are topologically isomorphic. Further, the corres- 
pondence i 

(5.88) v—> A?Ty 


yields a topological isomorphism between H,„(8) and L*,(d). This 
isomorphism maps the range of the operator £ onto the range of the operator 
L. (We remark that L is originally defined only on the functions of class C°”. 
These are dense in L?,,,(3). Asa bounded operator, L has a unique extension 
to all of L?,,(3). On the other hand, the original definition for L also 
makes sense on the piecewise smooth functions u satisfying (5.35). However, 
L is a bounded operator on these functions.) Hence, we have 


(5.39) Hon(d)/range £ = L*,,(3) /range L. 


Further ker L= ker £. Consequently, mdZL=ind£. We have therefore 
established 


THEOREM 6.2. The index of a special nX n elliptic operator of first 
order of characteristic w, on a surface 3 of genus p, ts equal to 


—o+n(l—p). 
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Remark. It is possible to establish Theorem 5.2 also for general first 
order elliptic operators of characteristic œ. This result, together with Theorem 
5.1 shows that the index of an elliptic system of first order is always an even 


integer. 
6. The degree of a characteristic matrix. In §4, we associated with 
each continuous mapping , 


Q: B> GL (n,C) 


an integer x«(Q) defined by the index of a related singular integral operator. 
In this section, we shall define a second integer 1(), called the degree of the 
mapping @. In order to do this, we consider the polar decomposition of Q, 


(6.1) â = (t4), 


where U is a unitary matrix. Set B=—tÕQ, and consider 
(6.2) Bm Sa (e-1—B) as, 


where we integrate around the spectrum of B, while z = 0 remains outside 
the contour. We take the principal branch of 24. Thus we see that Bè depends 
smoothly on B. Hence U is a continuous function on the cotangent sphere 
bundle 8 of 3. Observe that the dimension of # is three and that 8 is an 
orientable manifold because 3 is an orientable surface. We have the mapping 


(6.3) U: B>U(n), 
which we compose with the projection 
(6.4) aw: U(n) > U(n)/U (1). 


(We use the convention that for each k <n, U(k) is that subgroup of U (n) 
which is given by the imbedding 


es 0 ).) 

0 Ulko 

We observe that the third homology group of U(n)/U(1) is infinite cyclic 
[22, p. 134]. 


Definition 6.1. The degree 1(@) of the mapping ( is equal to the degree 
of the mapping ro U =f, i.e. if x, is the generator of H,(8;Z) and % is 
the generator of H,(U(n)/U(1);Z), then the degree is the integer j, where 
Taxes = JRs- 
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We now wish to compute the degrees of the characteristic forms of some 
of our special elliptic systems of §5.C. For this, we restrict ourselves to 
the case n=2. Then ( is of the form 


(6.5) a= (a), t, j= 1,2. 

Suppose that 

(6.6) o= (% 2) 
Q21 Gag 


is the unitary matrix which enters the polar decomposition of @. An element 
of U(1) has the form 


f 1 0 
(6.1) (G S) Ilan 
so that 
e EDEN) 
aa A/O y Ger May) 


Hence, the vector 
6. 9 o 
( ) es 
determines the coset of U(2)/U(1) to which U belongs. Of course, 
(6.10) ` [a |+ | az |? m 1. 


Thus, if we set au — Tt + 42%, ds, — 2° + izt, then the point (2, 2?, 2? ct) is 
a point in R* which lies on the unit sphere 9° of that space. Furthermore, 
it is clear that 
6. a s 

(artiy osal ( (det 7)-1 

gives a mapping of @ into the special unitary group 9 U(2). We can represent 
each coset of U(2)/U(1) uniquely in terms of an element of 8U(2). In 
fact, if the vector (6.9) determines an element of U(2)/U(1), then the 
corresponding element of SU(2) is given by 


(6. 12) ( = 


Ger Qir 


We see then that the sphere S* may be regarded as the group SU (2). 

Tf we consider the mapping @ of (6.5), then we can define another 
mapping g: 8 — 8 as follows: Each point of @ is mt into that point 
(2,2%, 2°, xt) € Rt, for which 


(6.13) At on ot} ie? pmo H iat, a= (| das 24 | as [28 
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We claim that the two mappings f =r o U and g are homotopic. Then f == gy 
and the degrees of the two mappings are equal. In order to see this, we set 


bir(A)  Bia(A) 
(6.14) B, = t (A) baa 2) 


—={(1—a)'@@ Hl 
Since the right side of (6.14) is the product of two non-singular matrices, 


| bar (A) |? + | Bar (A) |? 40, 


and we can define a mapping hı: 8— S? by applying the scheme (6.13) to 
the matrix B,. h, gives the desired homotopy. 

We have now associated a mapping g: 8— 8° with every mapping @: 
8—>GL(2,C) through (6.13). The degree of the mapping g is equal to 
1(@), by the homotopy argument above. Thus we have associated a degree 
with the first column of @. In a similar way, we can associate a degree with 
each row or column of @. We shall now study the relations between these 
degrees. We begin with 


Qir aa 
Aai Azs 


Jossi 


Lexma 6.1 [15, p. 69]. Let X be a triangulable space and f, g: X —> 8° 
two maps of X into 8°. Let y: S*-> 8? be the Hopf map. Then, if the 
mappings yf and yg are homotopic, so are the mappings f and g. 

(The Hopf map is just the fibering 

U(2)/U (1) > U (2)/U (1) X U (1).) 

Lumma 6.2. The column degrees of a mapping U: B > U (2) are equal. 

Proof. Beginning with U, we form the map 0: 8>SU(2) as in 
(6.11). Observe that the first columns of U and U coincide, while the second 
column of U is the second column of U, multiplied by det U-*. In view of 


Lemma 6.1, the degrees of the second columns of U and U are the same, since 
they yield homotopic mappings of B into S*. However, 


Gy. —& 
o -( 11 =) f 
Ger Aii 


( eo E (ir = 
1 0/\azı du au — Gq)” 


and the map B — SU (2) given by 


E= 


Now 
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is homotopically equivalent to the constant map 1. Hence the column degrees 
of 


coincide. From Lemma 6.1, we see that 


(=)mna(*) 
— Qz Gar 
are homotopically equivalent and thus have the same degree. Finally, the 


mapping t; t} JÆ jo Lp—> — Ty DT —1, of 8? into itself is of degree 
e : 
— 1. Hence the degrees of the mappings 


(=) ( a) 
Mer Gar 


Lemma 6.3. For a mapping 0: B 8U(2), 


are equal. 


row degree 0 — — column degree U. 
Proof. The matrix U is of the form 


Ü= ke ao! 
Gar 


The mapping (%, 22) — (2:,— ža) of 8° into itself is of degree — 1. 
We now turn to the third cohomotopy group, 7*(@) [15]. There exists 
a homomorphism 
"(8)>H°(8;Z) 


which is defined as follows. Let a€m’(8) and pick a map ¢: 88° 
which represents « Let ys be the generator of H?(8 ; Z), ds, the generator 
of H*(S*;Z). The image of a is defined as the element $*(d,) € H°(8;Z). 
But ¢* (Ps) =j-ys. The integer j is just the degree of the map ¢. In fact, 
<Ys X> = J <Way Xa> =1 
and 
<A” (Ya), xD = Jas xa) = dor baxs> = Aha, Ka), 

where d is the degree of ¢. Hence d= j. 

Lemma 6.4 [15, p. 213]. Let 0,7: B — 8U(2) (8°) be given maps 
and let a, B denote the elements of m’(B) which are represented by Û, V, 


respectively. Let aßEm’(B) be the element which is represented by UV: 
B—>SU(2). Then «Beat 8B. 


6 
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COROLLARY 6.1. With 0, V as above, 
tow degree UV == row degree Ü -+ row degree V, 
column degree OV 
== column degree Û + column degree V. 

The set of mappings Û: B — ŞU (2) certainly forms a group under 
matrix multiplication. In view of (4.7), « is a homomorphism of this group 
into the additive group Z of integers. By Corollary 6.1, 1 is also such a 
homomorphism. We note that if 1(0) —0, then x(Û) =0, by the discussion 
of §4. There exists a 0): B —> SU (2), with !(0,) —1 [15, p. 53]. Suppose 
that «(0,) =y. Then, for any U, with I(Û) == z, we have 1(0) = 1(0 9") =z, 
and 


KV) = 1(0) HOT) = g — z mm 0. 
Hence «(U0o*) = x(U) —zx(0)) =0, and 
x(Û) =x(0,)2 =yl(0). 
Lemma 6.5. If U: B->U(2) ts a given mapping, then 
row degree U = — column degree U. 
Proof. Consider the matrix function 


= 1 0 ee 0 ) 

ru, re) 2 © det U /* 
V is a map 8—>S8U(2). We observe that because of (4.7) and (3.5), 
x(V) =0. Further x(V) =0=yl(V). Since we have constructed elliptic 
operators of non-zero index in § 5, we know that y54<0. Hence, (V) —0. 


However, 


NK, rar act) AMD) HO) 


= column degree U -+ column degree U+. 


On the other hand, 
1 0 
G det alt 
1 


TU m1 09(4 aan) 
o=) = 10> (4 atu) + ja) 


go that 
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= column degree U-1 — row degree U. 


Hence, column degree U = — row degree U. 


THEOREM 6.1. The column degree lis a homomorphism on the group 
of mappings B>TU(R) into the additive group of integers. 


Proof. Consider two mappings U,V: B>U(2). If $: 8B>U(1) is 
a given mapping, then by Lemma 6.5, 


1 0 1 0 
column degree ( $ U = —row degree ( 4 a 


= — row degree U == column degree U. 


Hence, also 
column degree UV = column degree G herad UV 
= column degree G 2) UV f is 
= column degree © ae) U 


1 0 
-+ column degree y(i det a) ‚ (Cor. 6.1) 


= column degree U + column degree V. 


COROLLARY 6.2. The column degree lis a homomorphism of the group 
of mappings B —> GL(2,C) into the additive group of integers. 


Proof. Let Qı, Ads: B— GL(2,C) be given mappings and set d= Q.Q.. 
We have _ 
Q, = (da), Q= (':Q:)U, Q= (#42). 


We can define } through the degrees of the mappings discussed in (6.13), 
(6.14). But G;~U,;, j=1,2, as in (6.14), so that 


a = d.d.~ UU. 
Hence, 


(Q) = 1(UU2) =1(D,) +102) =1(Q,) +1(G2). 


Finally, we turn from the discussion of maps 8>U(R)/U(1), to a dis- 
cussion of maps 8—>U(n)/U(1). Let us consider the commutative bundle 
diagram 
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U(n) peli U(n)/U (1) 


(6.15) Ta i rı 
U(n)/U (2) 


The fiber bundle mı: U(n)/U(1) > U(n)/U(2) is associated with the 
principal bundle rz: U(n)>U(n)/U(2) and has U(2)/U(1) —8* as 
typical fiber. If i: 87 U(n)/U(1) is the inclusion map, then it is known 
'[22, p. 184] that 

14: H;(8°;Z) > H,(U(n)/U(1);Z) 


is an isomorphism. We now consider the following mappings: 


8—— U (2) en U(n) 
i Ww 
U(2)/U (1) ——> U(n)/U(1). 


Here +, is the imbedding discussed after (6.4). The mapping i maps 
U(2)/U (1) onto the fiber of mı: U (n)/U (1) — U (n)/U (2) which lies above 
the image of 7,°%. Consequently, tm = r 0 t. 

Let x, be the generator of H,(U(2)/U(1);Z). Then, with the notation 
of Definition 6.1, Xa == txs. By the definition of J, we have 


(73° U) sxs 1(U) Xe. 
On -the other hand, 


tya4U 4X0 meta U Xe =l (U) Xs. 
Consequently, we haye the result 
(6.16) (4U) =I (U). 


We now must discuss the homotopy classification of the maps 
B —> U (n)/U (1). Since the homotopy groups m;(U(n)/U(1)) are zero for 
jS, U(n)/U(1) is 2-connected [15, p. 188]. Assume that 8 has been 
triangulated. Call the resulting complex K. On the 2-skeleton K*, a map 
$ | K*, where ¢: BU (n)/U(1), is homotopic to a constant map, since 
for the boundary ¢ of any 3-cell o, ¢ | è defines an element of r: (U (n)/U (1) ) 
=0. It follows from the homotopy extension theorem [15, p. 14] that & is 
homotopic to a map $: B — U (n)/U (1), such that ¢ | K? is constant. We 
now define an element of H°(832,(U(n)/U(1))) as follows. Consider the 


ELLIPTIO OPHRATORS ON OLOSED SURFACES. . 625 


cochain c($), such that c(¢)(c)—[¢]|o], the homotopy class generated 
by ¢|o. c($) is then a cocycle. We denote its cohomology class in 
H°(8 ;,(U(n)/U(1))) by ($) = «°(%). According’ to a known gener- 
alization of the Hopf homotopy theorem [15, Cor. 15.3, p. 191], two maps 
$1 $2: B->U(n)/U(1) are homotopic if, and only if x°(¢,) —x®(¢2). 

Let a represent the generator of mg(U(n)/U(1)). Then we have 


l AH) (È ko)a, | 
where ksa corresponds to [$ | o]. We now apply the Hurewicz isomorphism. 
m(U(n)/U(1))>H;(U(r)/U(1);Z) which sends (a kg) @ into È ke) Xe: 
It becomes clear that the integer jum Lhe is just the degree of the ‘map $. 


Consequently, two mappings $1, 2: B> U(n)/U (1) are homotopic if and 
only if they have the same degree. Since we can obtain maps t73U of arbitrary 
degree, any map ¢: 8—>U(n)/U(1) is always homotopic to a special map 
of the form t7,U, with U: B —> U (2). 

If therefore V: B —>U (n) is a given mapping, it follows that ro V is 
homotopic to a map of the form ix; == riU. By the second covering homo-. 
topy theorem [22], the homotopy BXI—>U(n)/U(1) of roV can be 
covered by a homotopy V;: B X I>U(n). Thus roY,—ro4U, ie. Vy 
and +,U always belong to the same fiber of the bundle r: U (n) > U (n)/U (1). 
Since 4U is a member of the subgroup 


; : Ly 2 0° 
(oe): 
for all points of 8, V, must also belong to this.subgroup for every ‚point of 
8. Hence we have shown that every mapping 8—U(n) is homotopically 
equivalent to a mapping of 8 into the subgroup (6.17). This fact allows 
us to restrict all of our considerations to the special mappings U: 8B —> U (2). 
Formula (6.16) then gives us 1(V) =1(V,) =1(4,U0) —1(U). 


7. The identity of the index and the degree. In the discussion which 
precedes Lemma 6.5, we showed that «(U)—yl(U) for every mapping 
Ü:8>SU(2). Since, by $4 and Theorem 6.1, both x and } are homo- 
morphisms of the group of mappings B —> U (2) into the additive group of 
integers, then, for any map U:8—U(2), we must have 


x(U) =x«(0), (U) =0), 


where U and Û are related as in (6. 11). (The result for x follows from 
(8.5).) Hence we have 
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(7.1) R(T) m= yl (T) . 


for all mappings U: B —> U (2). In order to prove that the value of y is — 1, 
it is sufficient to show this for a single case, with «(U) 40. 

In 85.0, we constructed special elliptic operators of first order, of 
arbitrary characteristic. We now establish 


Turorem 7.1. The degree of a characteristic matrix of a special elliptic 
operator of first order with P=N—1, of characteristic zero, is equal to the 
negative of the Euler characteristic of the surface 3 on which the operator 
is defined. 


Proof. The characteristic matrix of a system of first order has the form 
Arg, + A? 
for the cotangent vector &de! + &de?. If we introduce a new natural base 
in the fibres of the cotangent bundle in terms of our conformal structure, we 
have dz = de! + idz*, dž = de!’ —idı?, and 
Ede! + éds? == + (é — i) dz + (+ i£,) dz} = ġdz +¢ di, 
where ¢ = $ (é& — t£:). Then 
A'E, + Aé FA + 14?) (6, — téa) + $(A*— iA?) (6 + iéa) 
— (A: + i47)g + (At 144) 8. 

However, we have 

(A+ 14") + (A*—1A?) ob 
(7.2) 

afara eat DC >) mia 3 (3 

rel SG rer ME 8). 
Further, for a special system of characteristic 0, with P =N ==1, (we can 
take 7 =1 in this case), 
= (A2)-141 7 1 i) 
A= (A*)74 i( 0 —1)° 
Hence 
aial A E aia, 
@ — 

Consequently, the characteristic matrix of our special system of characteristic 
zero is given by l 
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ace He ONT 0 
ren = C 3): 


Observe now that this matrix function defines a map of the non-zero cotan- 
gent vectors of 3 into the general linear group GL(2,C). Further, if we 
combine this mapping with the projection 


GL(2, C) > GL(2,C)/GL(1,C), 
we obtain a mapping of the non-zero contangent vectors into C,;—- {0}, where 
the image point is represented by the elements of the first column of the 
2x2 matrix, i . By dividing by (| 2 |? + | 2|?)#, we get a mapping 
2 

into 8°. It is clear that if ¢ is positive, then 

=) aì 

Za? \2t 
are projected into the same point of 8°. Consequently we get a mapping of 


the contangent sphere bundle 8 into S° == U (2)/U (1). We now consider 
the Hopf fibering 


S? = U (2)/U (1) > U (2)/U (1) X U (1) = Py = 83. 
This is just associated with the canonical complex line bundle of the complex 
projective space P,, and it is universal for dimension 2 [22]. The first 
Chern class of this universal bundle is known to be just the element 


ds € H?(S?;Z), the generator of this cohomology group. Observe now that 
our characteristic matrix gives a bundle map 


[| 
en? 


since each fiber of the bundle 8 —> 3 is mapped homeomorphically onto a 
fiber of the universal bundle. (If we denote the elements of 


4 1 0 
Át- iA? (s 2) 


by (by), then the characteristic matrix takes the form 


bird brah 
bard ba ` 
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Along a fiber of the cotangent bundle of 3, with a fixed local coördinate 
system, 641, Der remain constant, while $ varies. Thus the ratio bug: bad is 
constant along a fiber of the cotangent bundle (¢340). This means that — 
every image point of this fiber in $°, is projected onto the same point of 8? 
under the Hopf map. Consequently, the mapping under discussion maps 
each fiber of 8 into a single fiber of the universal bundle. From the nature 
of the mapping function, it is clear that the map is a homeomorphism of each 
fiber of 8 onto the corresponding fiber of the universal bundle.) 

Thus the first Chern class of 8 is simply given by f*xe However, it is 
well-known [14] that 


f*f [8] =—— (Euler characteristic of 3). ` 
Equivalently, we may say that 
fexa = — (Euler characteristic of 3) $s 


where xs, X2 are the generators of H,(3;Z), H,(S*;Z), respectively. 
We now consider the Gysin homology sequences [15] for the two sphere 
bundles: 


2 ja 
fa fe te | ts 
Ja 
0 = H,(S*?) > H,(S?) —— H, (S*) > Hs (8°) =0. 
Because we have a bundle map, the diagram is commutative, and fafi = jaf. 
The homology sequences are exact, so that j,, 7; are isomorphisms onto. Hence 
Sixa= Xe» jaxa = Xe, and . 
Petixe = faks = Jaf +X: 
= — (Euler characteristic) - jexa 
== — (Euler characteristic) ` xs, 


so that the degree of f, the map obtained from our characteristic matrix is 
‚equal to the negative of the Euler characteristic of 3. 


Corornary 7.1. If 3 is an oriented surface of genus pz#l, and U is 
.a mapping of the cotangent sphere bundle B of 3 into U(2), then 


«(U) = — MD). 
We now turn our attention to the torus. 
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THEOREM 7.2. For an oriented surface 3 of genus p—1, the charac- 
teristic matrix of a special elliptic operator of first order with P =N =1, 
of characteristic w, has degree 2w. 


Proof. The characteristic matrix (7.2) may be written in the form 
(A HAN) + AAN = (AT + ilI) + ATÄLT)ET- 


urn S(t pereen NE: 


For our special operator, 
TAT = T(A2) 41T — (i za) ; 
so that 
eriari z) i; 
Hence the characteristic matrix is 
(7.8) (Ar Ta +idrT, ( TE D } (% 2) Tat. 


However, the cotangent bundle of possesses a non-zero cross section {ga} 
in the present case, with gadz« = gpdzg. The cotangent sphere bundle may 
then be given by the vectors gaet? locally. Hence our characteristic matrix 
defines the function 


+6 
(MPa idtePalt N ee ie) iG a Ta 


on the cotangent sphere bundle 8 of 3. We now write this function in the 


form 
: 1 ONG /Ja ON a 0 
ai 2 I -1 
{4 aTa +14 Alo yt Gi Ja Ta Ta 0 er Ta 3 


i.e. as the product of two matrix functions defined on 8. Observe, however, 
that the first of these comes from a function defined on our non-zero cross 
section, i.e., a function defined on the torus. This function therefore defines 
an inessential map into S* [10, p. 299]. Consequently, the column degree 
of the first function is zero. The degree of our characteristic matrix is then 


just 
ef 0 7 
HTe( 0 3) a}. 


In order to compute this number, we must recall the construction of the 


ee 
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special elliptic systems of §5.C for general closed surfaces 3. If we use 
the local coördinate systems which we introduced there, then 


at e 0 
> (el re 


is invariant, sine T=1on d—D,. Since 


1 
the characteristic matrix (7.3), may be written as 


Atel a = sArT a © Zn i) 3 


Pa 0 -1 
(7.5) 2AraT a 05 2) Ta”. 
The reasons leading to the invariance of (7.4) also give the invariance of 
ı (Pa 0 ) 
(7.6) Arg ( ae be 


From the reasoning employed in Theorem 7.1, we see that the degree of 
(7.6) is the negative of the Euler characteristic of ð. We rewrite (7.4) as 


ow 0)\., (da 0\m.. [dat 0 ina gim [pa ee 
(2 ab 3) T= -(% jes) et te 


The right side is the product of two function on the cotangent sphere bundle 
B of 3. If the genus p of Æ is not equal to 1, then we also know that 


a 0 f e 0 
(7.7) KAlsTe (5 $ Tat} ——tdrTe(9 x) Te} 
from Theorem 5.2 and Corollary 7.1. On the other hand 
Pat 0 1-1) — eg, 

(7.8) u) AIR). 
Since } is a homomorphism we see that if p>£1, 

at 0 & 0 
(7.9) If (% =) Ta (% J Tat} — Ro. 


However, when we look at our matrix function (7.4) on the restriction 
of the cotangent sphere bundle to d — Dp, it is simply the constant function 


1, so that the bundle is mapped into the single point G \ of 3° by the first 


column of the function. Hence the entire contribution to the degree must 
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occur on that part of 8 which lies above Dp. This, however, is a standard 
Euclidean neighborhood. 

We can now turn our attention to the case p==1. Because the cotangent 
bundle of 3 has the non-zero cross section {ga}, so that we may take 
da = Jae, the function (7.4) may be written in the form 


48 -1 36 
er 
a a 
The function 
ga 0 Ja 0 -1 
amo GL: 


comes from a function on the cross section and thus has column degree zero. 
Clearly, 


g“ o 
(7.11) u( 0 2-0. 
Hence for the torus, 
ef 0 £ dat 0 0 _ 
(7.12) ur. i a) Ta =u ( a) Ta ta =) Ta} 
However, the column degree of the right side depends only on the local 


behavior of (7.4) above the special neighborhood Dp. Hence its degree is 
2%, and 


48 
KT, ( A ant) andes 


COROLLARY 7.2. Corollary 7.1 remains valid when p=1. 
These results immediately yield 


THEOREM 7.3. After a suitable selection of the generator xs of 
. Bs(U(n)/U (1) 32) 
x(Z) =1(@) 


for any maping Q of the cotangent sphere bundle B of 3 into GL(n,0). 
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INTEGRAL EQUIVALENCE OF VECTOR FIELDS ON MANIFOLDS 
AND BIFURCATION OF DIFFERENTIAL SYSTEMS.* 


By A. AEPPLI and L. Marxus?. 


I. Basic equivalence relations of vector fields and examples. Two 
vector fields on a differentiable manifold Mr are integrally equivalent if their 
integral curve families are topologically equivalent, see below for precise 
definitions. We shall study the relation of integral equivalence of vector 
fields on M” especially with reference to the concepts of structural stability 
and bifurcation of differential systems. We shall use the techniques of 
homotopy, for nowhere vanishing vector fields, as a guide in the theory but 
we note that a single homotopy class can contain a noncountable number of 
integral equivalence classes. We apply our general theory to a detailed 
analysis of nowhere vanishing vector fields on the torus surface T? and we 
find important properties and canonical representatives of the various integral 
equivalence classes. The existence of a noncountable number of integral 
equivalence classes for nowhere vanishing vector fields on the torus T” is used 
to demonstrate the existence of noncountably many such integral classes on 
higher dimensional manifolds. 

Let M* be a C differentiable n-manifold, that is, M” is a connected 
separable metrizable space which is locally homeomorphic to the real number 
space A", n= 1, and the local coordinates so determined are inter-related by 
C= maps with non vanishing jacobians. A first order, autonomous, real, 
ordinary differential system 3 on M” is a tangent vector field v on M”, that is, 
a cross-section of M” into its contravariant tangent bundle T(M*). In local 
coordinates (z,2°,- --+,a") on M" we write the differential system 3 as 


Bs Gime yt (gts > +, 2") i=l, ,m 


Let Y(Mr) be the real linear space of all C* tangent vector fields on M” 
with the usual compact-open C1-topology. We define this topology on Y (Mr) 
by a metric? 

* Received February 28, 1963. 

+ Research supported by NONR 3776 (00). 

*We put Do = grad v = (5) and the norms are defined by [|= sup | of |, 


av! 


Dv | = RASS 
Re ys Oa 








633 


634 A. AEPPLI AND L. MARKUS. 


oo ei v — t | | Dv, — Dv, | 
plost) = ZT | + LD Dun 


where each term of the sum is the supremum in a local coordinate patch Uz, 

«=1,2,' ' +, the sets Ua cover M”, and each Ua is compact and lies within 
some local coordinate patch on M”. The topology so defined on Y(Mr) is 
independent of the choice of the covering Ua. Thus Y(M*) is a Fréchet 
space and if M* is compact it is a Banach space. We shall often deal with 
the subset %(M*") consisting of all vector fields in Y(M*) which vanish 
nowhere on M”. If M" is compact, Y,(M”) is an open subset of Y(M*)? 


Definition. Vector fields v, and v, in Y(M*) are integrally equivalent 
in case there exists a homeomorphism of M» onto itself which carries the 
sensed (but not parametrized) integral curve family of v, onto that of v. 
“Here an integral curve ¢(#) of ve Y(M*) is a maximal solution curve of 
the corresponding differential system 


b: it = yt (gt, : +, a") el, on 


and a sensed integral curve is the class of all curves #(t(r)) where r>t(r) 
is an orientation preserving homeomorphism of R’ onto itself. Thus if v 
and v, in V(M”) are integrally equivalent by a homeomorphism ®, then ® 
maps each sensed integral curve of v, onto one of v, and vice versa for ®t, 
and ® maps critical points, periodic solutions, invariant and in particular. 
minimal sets of v, onto the corresponding objects of v. 

If v, and v, lie in Uo(M*) we say they are homotopic in case the corres- 
ponding cross-sections in 7,(M*), the bundle of nowhere vanishing tangent 
vectors, are homotopic maps by a continuous homotopy 


V: MX I> T, (M), 
which is a cross-section for each fixed ¢ in the interval J: OS¢=1. 


Proposition. Vector fields v, and v, in Vo(M*) are homotopic tf and 
only if they lie in the same arc-component of Uo(M*). If M" ts compact, 
each component of Yo(M*) is also an arc-component. 


Proof. The vector fields v, and v, are in the same arc-component of 


*( continuity for vector fields has to be considered if stability problems are dis- 
cussed whereas a strong form of O° continuity (Lipschitz) is usually enough in dealing 
with questions on integral equivalence (ie. O° integral equivalences as defined here; 
there are pairs of integrally equivalent vector fields one.of which is structurally stable, 
the other one unstable, cf. [7] and see Example 3). Thus Theorems 1, 2, 3, 4, 5, 8 
make sense if the 0° topology (and Lipschitz continuity) is used. , 
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Vo(Mr) just in case there is a continuous map of the interval I: 0S¢tS1 
into Y,(M*) which defines a curve v; joining v, to vı.. In this case 
| (P,t) > 0,(P) 
defines a map 
M*x I-T,(M") 


which is a Ot cross-section for each fixed tE I and which is continuous on 
the product M” X I. Hence v, and v, are homotopic. 
On the other hand let v, and v, in Y.(M") be homotopic by 


V:MrxI>T,(M"). 

We define a cross-section 

Yx1:MXI>T,(M)xI 
by 

Yx1:(P,t)>(V(P,t),t) 
for PE Mr and teI. We approximate the continuous cross-section V X 1 by 
a C1-cross-section [12] and so construct a C*-homotopy V+ of ve to v 

Vi: MX I>T,(M"): (P,t) 3%, (P). 
Let U: (a1, - -,2”) be a local coordinate system on Mr with compact U 
lying in some local coordinate system, and we write 
Vi: at = Ot (at, - “+, a") it), i=l, >n, 


where òt (qt, + -,2",t) is in Otin UXI. Thus 


mp Taat) + (2.4) Bean < 
sUh ld = Era $ 


whenever |ts —t | <8(e), for a prescribed e> 0. 
Choose a sequence U;,U3,---,Uc,:-+ of such coordinate systems 
covering M” and we then compute the distance in Y,(*), 
€ so 


N 
p(t) SE ge py + BM 


a=N+ 





whenever | ¢,—t, | < min [8,(e),- - <, dy(e)]. Thus the map 

I> V,(M"):t>% 
is continuous and so v, and v, are in the same arcwise connected component 
of Uo(M"). 


Now let M* be compact. Then Y(Mr) is a Banach space and V, (Mr) 
is an open subset of Y(M*). Thus Y,(Mr) is locally arcwise connected and 
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each component of Y,(M*) is open in Y(Mr). Let A be a component of 
(Mr) and letve A. The set of points of V, (M*) which can be joined to v 
by a continuous curve in Uo(M*) is clearly open and closed in A and hence 
must coincide with A. Thus A is arewise connected. Q.E.D. 

In general, integrally equivalent vector fields v, and v, of Va( M”) are 
not homotopic. However if the integral equivalence is defined by a homeo- 
morphism & which is sufficiently “close to the za and smooth,” then 
v and v, are homotopic, as is shown next. 


PROPOSITION. Let vo and v, in V(I”) be integrally equivalent by the 
homeomorphism ® of M” onto itself. If © is O*-isotopic to the identity map 
of Mr, then v, and v, are homotopic. 

Proof. Let 

8: Mr X I>Mr: (P,t)>%,(P) 
be the isotopy with &,(P) in Ct on M™ XJ and 
S.(P)—=0(P),  &(P) =P. 
Here ==, carries the integral curve family of v, onto that of v,. Since 
each &, is a O1-diffeomorphism of M” onto itself, we can define the vector 
field v;€ Uo(M*) as the image of v, under the map ®;, Then v; is the 
required homotopy joining v to v Q.E.D. 

These ideas of homotopy and of integral equivalence have applications to 
the concepts of structural stability and bifurcation in the theory of differential 
equations, as described below. 

A differential system, or vector field ve V(M*), is structurally stable in 
case: for each prescribed neighborhood H of the identity in the group of all 
homeomorphisms of M” onto itself, there exists a neighborhood N of v in 
Vit") such that each v, € N is integrally equivalent to v by a homeomorphism 
of H, see [7]. Thus for a structurally stable ve Y(M"), the integral equi- 
valence class of v contains a full neighborhood of v in Y(M®). 

A continuous map from a topological space A into Y(Mr) 


A> VU(M") : A> oy € UV (HM) 


is called a family of differential systems which is parametrized by A. In local 
coordinates (z},- - -, g”) on M” we write 

By: Samy! (24, - +, a") = vi (T, À) i=], ',n 
where vt(a,A) and dvt/öx!(x,X) are continuous in (z)X A. A point MoE A 
is an ordinary point for the parametrized family 3, in case there exists a 


neighborhood L of A, in A such that g, is integrally equivalent to dy, for 
each A,€ L. If A, is not an ordinary point, then A, is called a bifurcation 
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point for the parametrized family 3). Clearly the set of ordinary points of 
3 is open and the set of bifurcation points is closed in A. 


Example 1. Consider the n-torus T” asa differentiable manifold obtained 
from Æ” modulo the group of integral translations. Using coordinates 
(zt, + +,2") (modi), consider the differential systems on T” 


By: tt) el, -n 


where A == (A},- - +, A”) is a constant nonzero n-vector. Then dy is a family 
of differential systems in Y(T”), parametrized by A—=Rr—0. If the 
vector space F} generated by At,- - -,A” over the rational field F has dimen- 
sion k, 1<k=n, then each minimal set (compact invariant set which con- 
tains no proper compact invariant subset) of 3 is a k-torus, see [3]. In 
particular every solution curve of æ, is periodic if and only if k—=1. Since 
the rational vectors A are dense in A, none of the differential systems 3) is 
structurally stable and every value of A€ A is a bifurcation value. 

Choose a homology basis for T*, say the cycles corresponding to the 
coordinate circles of z!,2%,- > -,x". Let S(t) be an integral curve of 3) 
initiating at P € Tr and let N be a small ball neighborhood of P in Tr. Let 
Lt [L'i <: be an infinite sequence of times for which S(t,-) 
meets N, lim t, ==%, and let fh, f2, - "sin" * - be the sequence of homology 

row 


classes in H,(T”) determined by S(t), OS tS t, and thence joining S(t,) 
with P by a small arc in N. If we express f, in terms of the chosen basis of 
H,(T*) we obtain a nonzero integral vector 


l, == (art, . + ay"). 


As r—>o the direction cosines of the vector l, approach At/|A|, t==1,-- +, n, 
where | à | = (A"-++----+-A*")4. Thus the homogeneous coordinates (A1,- --, A") 
are topological invariants of 3, and are defined to be the generalized rotation 
number of 3, relative to the given basis of H,(7), cf. [11]. 

A homeomorphism of T” onto itself induces an automorphism of H,(T") 
which is described by a unimodular matrix A (integer matrix with deter- 
minant +1), relative to a basis of H,(7T*). Thus the generalized rotation 
number of 3, with respect to any basis of H,(7") is a unimodular transform 
- of A, that is, AA. "Since there is only a countable number of unimodular 
matrices, there is at most a countable number of the systems æ, which are 
integrally equivalent to a fixed 3,,. Therefore there is a continuum of integral 
equivalence classes of Y(7") represented by the various systems 3, for AE A. 

In the study of V,(T?) we can define the classical (non-homogeneous) 
rotation number A of a nonlinear differential system [2] 


y 
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ð: =l, g(r, r?) 
using a point P on a recurrent solution S(t) of d on T”. The rotation 
number A, defined just as above, is independent of the point P, the neighbor- 
hood N, and the recurrent solution S(t). Hence A depends only on 3 and 


the homology basis of H,(Z*). There is a periodic solution of 3 if and only 
if A is rational. 


THEOREMm 1. Let M” be a differentiable mantfold. The cardinal number 
of integral equivalence classes in Y(Mr) is that of the continuum. If n= 2 
and V, (M") is not empty, then there is a continuum of integral equivalence 
classes in Vo (Mr). 


Proof. Since Y(Mr) has the cardinality @ of the continuum, the number 
of integral equivalence classes is at most &. 

Let v€ V(M”) be a vector field with precisely one zero P, on Mr. 
Take local coordinates on M” which define a diffeomorphism of an open set 
U C M” with the ball 2°+.---+-2" <1 in R”, with P, corresponding to 
the origin. Let f be a real differentiable function on M” such that f(P) =1 
on M*—U and f(z) =1 for s -+ : -+2 24. Let ZC U be the compact 
set of zeros of f and assume P,€EZ. Then Z is the set of critical points of 
fv. on M”. But the cardinality of the number of homeomorphism types of 
compact subsets of a ball is certainly @. Thus the vector fields fv, € U(M"), 
as f describes the admissible class of real functions, determines a continuum 
of distinct integral equivalence classes. 

Now let n = 2-and assume that M* is either noncompact or M* is compact 
with Euler characteristic zero so that Y.(M*) is not empty. First assume 
n>=3 and let T" be a small torus submanifold contained entirely in one 
local coordinate system (a7,--:+,2*) of Mr. We define a vector field 
vo € Y(M*) so that T* is a minimal set for vo, and on T” the vector field 
is integrally equivalerit to a linear differential system 3, as in example 1. 
This is possible since such a field exists on the solid torus A bounded by 7, 
and since M” is either noncompact or has Euler characteristic zero. By 
appropriate choice of A we can describe a continuum of topologically in- 
equivalent vector fields on 7”. In order to complete the proof we must 
define vs € Yo(M*) so that any homeomorphism of M» onto itself which pre- 
serves the integral curve family of 7, must map 7’! onto itself. 

For convenience use a real analytic structure on M” with a real analytic 
Riemann metric (this can be done by Whitney’s imbedding theorem). We 
modify vo near Tr so that 7" is stable, that is, the normal component of v, 
points towards 7” from both sides of 7-1. Now approximate vo by a real 
analytic vector field v, outside a neighborhood of the solid torus A which is 
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bounded by T**. Using interpolation to blend v, into Vvo, we obtain a vector 
field v, € Yo(H™) where v, = v, outside a neighborhood of A, vz has normal 
component directed towards T** near T**, and v,==v, on T**. Inside Tr 
we can further require that v, has a family of periodic solutions, with the 
same period, which fill a subset = of A so that X is compact and has a non- 
empty interior in A. Since v, is real analytic outside a neighborhood of A, 
it has no collection of periodic solutions homeomorphic to 3 outside A. There- 
fore T*! can be topologically characterized as the unique minimal (n—1)- 
torus which contains within it a family of periodic solutions whose union is 
compact and also has a non empty interior in M”. 

Finally let n=?2. If M? is compact with Euler characteristic zero, then 
M? is either the torus T* or the Klein bottle. In either case it is easy to 
construct a continuum of topologically different vector fields in V, (M°) by 
demanding topologically different sets of periodic solutions on M?. 

If M? is a noncompact surface we consider the boundary B of M? (defined 
by sequences of compact subsets of M? under exhaustion, see [1,4]). I£ 
B has just one component, then M? is either the punctured sphere, the projec- 
tive plane, or the Klein bottle; or M? has a handle. If Af? is R?, then there 
is a continuum of integral equivalence classes in Y,(R*), as is shown in [6]. 
If M? is the punctured projective plane or the Klein bottle, it is easy to give 
explicit descriptions for a continuum of integral equivalence classes. If M°? 
has a handle, then we can construct two smooth simple closed curves around 
the meridians of the handle, to form an annular region A around the handle. 
Then define a continuum of topologically different structures of periodic solu- 
tions within A and define the corresponding vector field outside A to be real 
analytic and nonvanishing. In this way we can define a continuum of integral 
equivalence classes of V, (H°). 

Jf the boundary B of the noncompact surface Af? is not connected then 
let A be an annulus bounded by two smooth closed curves on M? which 
separate two components of B. Then a vector field v defined on A with a 
prescribed pattern of periodic solutions, can be extended to all M? with no 
critical points. Here again we obtain a continuum of integral equivalence 
classes in Vo(M?). Q.E.D. 

Example 2. Consider T? as R? modulo the group of integral translations 
so that (21,2) (mod1) serve as coordinates on T?. Consider the differential 
systems v, and vı EV., (T?), 

Vy: E= cos, $? == Bin dur? 
and 
qi È = —cop2er?, F? m gin ra’. 
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The homeomorphism 
8: (21, °) > (— a1, 2°) 
defines an integral equivalence of v, with va. But the degree of v, is (1,0) 
and the degree of v is (— 1,0), computed with respect to the cycles st == 0 
and x? == ( as defined below. Hence v and v_, are not Pome 
Eaample 8. Consider in 2? l 
"v: == COB T’, 2 om gin g? 

which has the lines # = 0, £? — nr for n= + 1, + 2,: - - as integral curves. 
Using the integral curves of. v, we can define a map f: Yo— y (yo) from initial 
points (0,40) for 9 —>0-+, to endpoints (0,y) for y„>r—. The map f is 
nonsingular in that a m dy/ dy. #0, in fact this derivative is nonzero regard- 


less of the differentiable local coordinates used near (0,0) and (0,7) in R?. 
Now we define a homeomorphism of R? onto itself by 


mode Mole (2). 
Then in R? we define the system 
D: t = cos(z*)*%, T? == 3 (a?) % sin (a*) 4, 


We note that v and @ are integrally equivalent by the homeomorphism ®. 
However v and ö are not integrally equivalent by a C?-diffeomorphism of R° 
onto itself since for 6 the map f, defined just as the map f for v, must be 
singular. 

This example shows that the relation of integral equivalence under C?- 
homeomorphisms is too delicate for the geometric analysis of the qualitative 
nature of differential systems. It is easy to construct examples of differential 
systems v and 5 in Y,.(T*) which are topologically, but not Ct-homeomor- 
phically, integrally equivalent. We need only construct a v with two periodic 
solutions around meridians of T°, each with a non-vanishing characteristic 
exponent. Then take ð to be topologically integrally equivalent to v but 
require that all characteristic exponents of 0 are zero.* 


2. Integral equivalence on the torus T?. Consider the torus T° as a 
differentiable (this means C° unless otherwise qualified) manifold. Choose 
a diffeomorphism of T? with S* X St, where S* is the circle group of all 
complex numbers of unit modulus. Use the parallelization defined on T° 
by this product structure to fix a diffeomorphism of the tangent bundle T (T°) 


‘Similar examples exist in higher dimensions.—In dimension 2, the characteristic 
exponent is invariant under (* diffeomorphisms; in general, the transversal germ of 8 
periodic solution is a linear transformation R**— R* whose eigenvalues (the charac- 
teristic multipliers) are 07 diffeomorphism invariants. Cf. [7]: 


. VECTOR FIELDS ON MANIFOLDS. ‘641 


with 7? X St. For each vector field ve Yo (T°) we then have a well-defined 
map 7?->7T? x 8". If we write T? as 91X 81 and use the projection map 
of T? X §* onto S* we obtain a map 
EX _ 
This map, restricted to 1X S* or to S* x 1, has an integral degree. 
Definition. Fix a diffeomorphism mg x. 81, and then for each vector 
field ve V,(T?) the map St x ‘St $1 is defined with degrees a, and a, for 
the restriction to each factor, as above. The degree of v is the ordered pair 
of integers (a,,a,) with respect to the assumed product structure of T°. 
Remark. The degree (a,,0,) of v€Y.(T?) depends on the diffeo- 
morphism 7? = 6X 8t. in particular on the basis of cycles for. AZ"); 
the two basic cycles being parametrized by the angles 9,,8, such that we get 


a parametrization of S? X 81. If this diffeomorphism is replaced by another, 
obtained by composition with an automorphism of S' x 8%, 


6, —> Ñ, = a, + 80; 


> 6, == y0, + 865 
where the integral matrix 
A (@ A 


\ y 8 
has determinant 


det A= + 1, 

then the degree of v becomes (d,,4,) where 
Gy = a + OB 
Gy = hry + ae. 


Since any diffeomorphism of 8? X S* onto itself is differentiably homotopic to 
an automorphism of S+ X S* as above [4,12], the degree of v can be (a, ae) 


or any pair of integers 
()-4() 


where the integral matrix A has determinant +1 or —1, and all such uni- 
modular matrices A can occur. 


THEOREM 2. Fis a diffeomorphism T?==§8'X S! and consider the 
. collection Yo(a,b) of vector fields in Yo(T?) with degree (a,b). Let 


d==g.c.d.(a@,b) >0.5 


: Then there exists a diffeomorphism of T? onto itself which carries all members 
of Uo(a,b) onto all members of Uo(d,0). Furthermore tf 
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dı ~ da are non negative integers 
then any v, € Voldy 0) and v2€ Vo (ds, 0) are not integrally equivalent. 


Proof. To prove the existence of a diffeomorphism of T? onto itself 
carrying Va(a, b) onto Vo(d,0) it is saging to construct a unimodular 


matrix A such that , 
d a 
H-6) 


aa + b8 = d 

ay + bê = 0. 
Now a/d and b/d are relatively prime integers and so there exist integers a 
and 8 with 


or 


a(a/d) + B(b/d) —1. 
Take 

y=—b/d, = a/d 
Bo 


aS — By—a(a/d) + B(b/d) —1. 


To prove that no members of V.(d,,0) and Vo(d,,0) are integrally 
equivalent, for dı >£ da, note that any such homeomorphism of T? carrying 
the integral curves of v, € Vo (d, 0) onto those of vz € Uo(ds, 0) can be factored 
into a diffeomorphism & followed by a homeomorphism % homotopic to the 
identity. Now ®v, has degree, relative to the fixed product structure, 


d a 
= G ) = ( ): 

where A is an integral matrix with determinant +1. Finally we shall prove 
that the degree of Töv,—v, is also (a,b). 

Let f, and la be homeomorphic images of 8! in 7? which are homotopic 
to the curves 1X S* and SX 1 in T?—§" X S", respectively. If f, is a 
nonsingular differentiable curve -with parameter 6, on 0S 6, < 2z, let A9, be 
the angle between the tangent vector to f, and the vector of va in the positive 
sense of the orientation of T”. Then 


dg = = f da0, 


: where the integral is computed positively around fı. A similar integral around 
f; would yield zero. Now we can define this integral around f, purely topo- 
logically. Assume f, is only a topological image of 8* which is homotopic to 


Sg.¢.d.(0,0) =0 by definition ——VU, (a, db) are the connectivity components of 
VT), — <a, b <+ %, corresponding to the elements of the Bruschlinsky group 
a(S x 8, 8) ce W* (8 x 83). 
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1x St. Assume further that the integral curve family of vs has only a finite 
number of simple crossings with f. That is, at every point of f, except at 
the crossing points the corresponding integral curve of v, initially penetrates 
one of the two sides of f, in T?, and at the finite number of crossing points 
of f, the designated side changes. Also assume that, at a point which is not 
crossing point, a short segment of an integral curve of v, crosses a sufficiently 
small circle (around the intersection point of f, with the considered integral 
curve of v) either ahead of the corresponding point of f, or else definitely 
behind the corresponding point of f. In this way we can define positively 
rotating and negatively rotating crossings of v, over fa. If these crossings are 
counted (+1) and (—-1) respectively, the algebraic sum of the crossings 
of v, over f, is exactly de, see [4]. A similar construction for f, yields the 
crossing sum of 0. 

Now under the homeomorphism W of T? carrying v, onto &v,, the 
crossing sums are invariant, since W> is homotopic to the identity. That is, 
the crossing sum of v, over f, is equal to that of v, over Yth, which shows 
that 
} di = 4. 

Similarly 
0 =b. 


But there is no unimodular matrix A which transforms the vector e) 


to 3) if d,54d,. Therefore v, € Vold, 0) is not integrally equivalent to 


VE Volda 0) when d,s4d,. Q.E.D. 


COBOLLARY. If v€ Vo(T?) has degree (0,0) in one product structure 
of T? then v also has the same degree (0,0) with respect to any other product 
structure T? = §* X S! of the torus. 


Remark. From the result of Theorem 2 we can obtain a complete list of 
all integral equivalence classes in %,(Z*) by listing the integral equivalence 
classes in each of the separate spaces Yo(0,0), Vo(1,0), Vo(2,0),° °°. 

The next theorem cites a geometric property of the set %,(d,0) which 
emphasizes the significance of the non-negative integer d. We will count the 
number of periodic solutions disregarding differences in periodic solutions 
due only to translations in time. 


Turorem 3. If v€ Uo(d,0) for d= 0, then there are at least 2d periodic 
solutions of v on T”. There exist members of Vo(d,0) which have exactly 
2d periodic solutions. 


Proof. Suppose there are no periodic solutions in v. Then using the 
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orthogonal trajectory to v, with a slight modification to construct a closed 
curve, see [2], we can obtain a Ct diffeomorphism of T° onto itself so that v 
has positive longitudinal velocity in the new product coordinates. Call these 
coordinates (z,y) (mod1) and around the meridian circle 2-0 we note the 
degree a— 0, since > 0 on v. To compute the degree b around the longitude 
circle y = 0 we use instead of this circle a homotopic curve composed of an 
arc of a solution of v between two consecutive intersections with z==0 and 
also a segment of the meridian z=0. We note that the degree of v on this 
closed curve, as computed by the line integral in Theorem 2, is zero. Thus 
v has degree (0,0) in the new product coordinates on T? and hence also in 
the original product coordinates. Thus ve Y(0, 0). 

Let ve Yo(d,0) with d>1. Then v has at least one periodic solution ; 
and we assume that v has only a finite number of periodic solutions. Suppose 
there were just one periodic solution 8 of v. Then there is a C'-homeomor- 
phism of 7?—g onto a plane annulus A and we can identify both boundary 
curves of A with S. Each solution curve of v’, the image of v in A, must 
have its negative limit set on one boundary curve of A and its positive limit 
set on the other boundary curve. For otherwise the Poincaré-Bendixson - 
theorem guarantees the existence of a periodic solution of v interior to A 
and hence a periodic solution of v on T? different from S. Now we can com- 
pute the degree of v on T? relative to a homology basis of closed curves fi, fa. 
Take f, to be the periodic solution $ which is homotopic to the longitude 
circle on 7%. For f, use an arc of the spiral solution of v which approaches 
8 from one side as 5>—« and J from the other side as t—> +o and then 
supplement this arc by two short pieces of the orthogonal trajectory of v to 
reach $ so as to make fa a closed curve. Using the line integral described 
in Theorem 2, we compute the degree of v around fa to be zero. Thus the 
degree of v relative to some product structure is (0,0), which contradicts the 
assumption that v€ %,(d,0) with d=1. Thus v must have at least two 
periodic solutions. . 

Therefore the first assertion of the theorem is proved for d = 0 (trivially) 
‘and d=1. Now assume d=2.and ve Y.(d,0) has a finite number of. 
‘periodic solutions. There exists a C” nonsingular simple closed curve 6, 
homotopic to the meridian circle on 72, such that @ meets each periodic solu- 
tion of v in just one point and each such intersection is orthogonal in the 
obvious Riemannian metric on T? = 81X 9. Let Ag, as a function of the 
angular coordinate # on @, describe the angle from the tangent vector to @ 
positively around to the vector field v, as in Theorem 2. 

Let S, and 8, be consecutive periodic solutions of v as ordered by their 
intersection points with @. Then 
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mSaa0) From $B to BaN B 


is p/2 for some integer p. By considering the region of T? bounded by S; 
and 9, as a plane annulus and using the Poincaré-Bendixson theorem as above, 
we can prove that p==0 or p—: 1. Since each interval along @ between 
consecutive periodic solutions of v can contribute only 0, $, or — 4 to the 
line integral for the degree of v around @, there must be at least 2d such 
intervals. Thus there must be at least 2d periodic solutions of v on T’. 

' Finally we give examples of vector fields which realize the minimum 
number of periodic solutions for each d= 0. 

For d=0 consider 
t= 1, ý= Ve 


in product coordinates (x,y) (mod1) which has no periodic solutions. 
For d21 use product coordinates (x,y) (modi) and consider the 

differential system 

t == cos (2rd y) 
va) 

ý = sin (2rd y). 
An easy sketch of the solution curves shows that vg lies in Y.(d,0) and has 
exactly 2d periodic solutions. Q.E.D. 


COROLLARY. Let v€ Uo(T?). If no solution of v is peta or if every 
solution of v is periodic, then v has degree (0,0). 


Proof. If v has no periodic solution then we obtain a O” simple closed 
curve @ nowhere tangent to v, as in the theorem. Then it is easy to compute 
the degree (0,0) for v, as is done in the theorem. l 

If every solution of v is: periodic, say (without loss of generality) 
homotopic to the longitude circle y = 0, then vE Y,(d,0) for some d= 0. 
But here we can choose the transversal curve @ so that every solution of v 
meets @ in just one point and is not tangent to @. This can be done by 
using the existence of local cross-sections for v and also the fact that the 
integral curves of v are cyclically ordered by the regions into which they 
separate T?. Then the degree of v around the circle y=0 and also around 
the curve @ is zero. Thus the degree of v is (0,0). Q.E.D. 


THEOREM 4. -In sach Vald, 0) for d=0, the cardinality of the number 
of integral equivalence classes ts that of the continuum. 


Proof. For d==0 use the differential systems 


i=l, der 
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where A>0 is irrational. The classical rotation number of this system on 
the torus (z,y) (mod1) is A, see [2]. Now a homeomorphism of T? onto 
itself can modify the rotation number only by a an integral unimodular trans- 


formation 
a b\ . a+b 
a=(¢ 2) u A 
Thus we obtain systems which are not integrally equivalent by choosing 
irrational rotation numbers which are not unimodularly equivalent. Since 
there is only a countable set of irrational numbers unimodularly equivalent 
to a given A, there must exist a continuum of such equivalence classes to 
constitute the continuum of all positive irrational numbers. 
Now consider d= 1 and 


va: $= cos? (2rd y) 
ý = sin" (2rd y), 0=4,y51, 





but take the torus to be (modi) and y(mod2). On 0X21 and 
142 we supplement va by another differential system v, defined below, 
so that the entire system is in Ct on T? and still has degree (d,0). Let K be 
a compact subset of the real interval 1 y<2 defined as follows: 


K=K,UK,UK,U: * "U K,U: bs U (2). 
Here Ko is the interval 1 Sy S 5/4, 


K. is the interval 3/2 <y< 3/2 + 1/8 
K, is the interval 7/4 £y < 7/4 + 1/64 


2 
K, is the interval ee srs n + 


Let s be a real number on 0 <s<1 with decimal expansion 
À § =mc , 818383 ° 


where each integer s, is on 0=s,=9, and say for definiteness that hate is 
no terminating sequence of 9’s. Let K(s) be the compact subset of L=y <2 
obtained by adding to K exactly s, points in the interval between X, and Ks, 
say equally spaced, then s, points between K, and K,, and s, points equally 
spaced in the open interval between K, and Kan, for n==1,2,3,---. Then 
it is clear that if s and s’ are distinct real numbers, 0 < 38,8’ <1, there is 
no homeomorphism of the interval 1=y=2 onto itself which maps K(s) 
onto K(s’). 
For each O<s<1 define v, in OS 2e1, 1lSy=H2 in T? hg- 
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v: fs=1 
ý = $. (4). 


Here ¢.(y) 2 0 is C” on 1=y=2 and is zero just for s€ K (s). We need 
only define ya(y) > 0 in each open interval of [1 Sy S2] —K (s) so that 
p(y) is in O” in the closure of this interval and has all derivatives zero at 
the endpoints. Such a construction is standard, see [12], and then define 


bs(y) = ye (y) F09 


to obtain the required differentiability at y==2. Now v, has periodic solutions 
t=}, y =y at just the values y, € K(s). In between the periodic solutions 
of v, are spirals approaching these periodic solutions. 

The entire differential system on T°? consisting of vg on OS y S1 and v, 
on 1 Sy2 forms a C* system in Y,(d,0). It is easy to see that for real 
858° the corresponding differential systems on T? are not integrally equi- 
valent. Q.E.D. 

THEOREM 5. Lei NZI be an integer and consider all differential 
systems vE Uo(T*) each of which has exactly N periodic solutions. Then 
there are at most 4N integral equivalence classes of such differential systems 
in Vo(T?) having precisely N periodic solutions. 

Proof. Let vE Yo(T?) have exactly N = 1 periodic solutions. We shall 
show that v is integrally equivalent to one of at most 4% standard models, 
ef. [5,10]. 

By using a preliminary diffeomorphism of T? onto 8: X 8", we can assume 
that each periodic solution of v lies in the homology class of the cycle y=0 
in the product coordiates (z,y) (mod1) in 8+ 8. Next we show that we 
can further assume that each periodic solution lies on a horizontal line 
y == constant. 

To see this consider the closed regions R, Ra, © ‘Ry in T* bounded 
by the N periodic solutions of v. Each R; is diffeomorphic with a plane 
annulus A, bounded by nonsingular C° simple closed Jordan curves. By 
results of conformal mapping theory [13], each R; is C'-homeomorphic to a 
standard circular annulus A; Thus the entire torus T? is the union of the 
plane annuli, with certain identifications prescribed by C*-homeomorphisms of 
the bounding circles. Further each A; is C*-homeomorphic to a plane square 
Qi: OSS 2, y1 with the standard identification (0,y) = (1,y) and we can 
also require that the induced homeomorphisms between the sides y = 0 or 1 


6 Putting d = 0 in this construction—or considering just the flelds v, for 0 < 8 < 1— 
yields again a continuum of different integral equivalence classes in U,(0,0). 
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for consecutive squares Q; be obtained by identifying appropriate points having 
the same z-coordinates. This apparent simplification of the identifications on 
the squares Q; can be achieved since any orientation-preserving C*-homeomor- 
phism of S* onto itself is C*-isotopic to the identity map (as is easily proved 
by using elementary convex combinations of the mapping functions) and so 
the map between the boundaries of A; and Q; can be extended to the required 
map of A, onto Qi. This defines a homeomorphism h of T* onto U Qe the 
joined Q; with identifications as-described above. Thus k is a homeomorphism 
of T? onto T° which.carries v onto 0. The vector field 9 on 7” has N periodic 
solutions, each of which lies along a line y == constant, in appropriate product 
‘coordinates. We note that 3 in each square Q, that is in the closed annular 
region bounded by periodic solutions on T°, is in class C*. We can also take 
ý to be a unit vector field in the product coordinates in each Qi 

We enumerate the possible integral equivalence classes of v by showing 
that ð in each Q; is integrally equivalent to one of four standard models in 
the square Q: 02,yS1, : 


a) sl, yoy(l—y) or Va 
b) ¢=1, ý =y(y—1) or v 
c) =coszy, y=y(1—y) or v, 
d) $= o8 7y, ý =y (y —1) or va 


Note that the additional four models obtained from these by replacing ¢ by 
—# need not be counted. For we can specify > 0 on a selected periodic 
solution of ð and then a choice of just one of four models is possible for the 
adjoining annular region on T?. Once this choice is made there is again a 
choice of just one of four models (either those above or those obtained by 
t—>— t) for the next annular region, in an obvious cyclic ordering. Thus 
for each annular region between periodic solutions of 5 on T? there will be a 
choice of just one out of four cases. So we obtain an upper bound of 4% 
integral equivalence classes for v on T?, as stated in the theorem.’ 

By the Poincaré-Bendixson theory of differential equations in a plane 
annulus, we find that 3 in Q, must belong to exactly one of the four cases: 


1) ż=1 on y=0, ġ=1 om y=1 
each solution of 5 has (y = 0) a» < —) limit set and 
(y =1) as (+) limit set - 


"A differential system on T° composed of standard models a), b), e), d) in con- 
„secutive annuli.is in general not of class Ọ*, but it is of sufficient regularity (Lipschitz 
<> continuous) to insure uniqueness of solutions, and this is sufficient for the study of 
integral equivalence relations as it is done here. 
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2) ġ=1 on y==0, ¢=1 on y= 1 
each solution of 5 has (y==1) as (—) limit set and 
(y=0) as (+) limit set 

3) f—1 on y=0, f—=—I1 on y= 1 
each solution of J has (y==0) as (—) limit set and 
(y=1) as (+) limit set 

4) t=1 on y==0, = —lony=1l 
each solution of 5 has (y—1) as (—-) limit set and 
(y==0) as (+) limit set. 


We shall prove that in each case 1), 2), 3), or 4) 3 in Q; is Span to the 
model a), b), c), or d), respectively, in Q. 

Consider case 1). We shall construct a transversal T(s), a nonsingular 
C+-homeomorph of 0s<1 in Q, joining the point z = 4, y =0 to t=}, 
y==1 and such that T(s) is nowhere tangent to ð. To construct T(s) use 
short segments of the line s = 4$ near y—0 and near y==1, and then join 
these segments by a smooth curve which lies close to a solution of 7, but so 
that I'(s) crosses the solution curves of © and is nowhere tangent to @. 
Of course, T’(s) might wind many times around the annulus Q, (we use Qi 
to designate the square or the annulus obtained by the identification 
(0,y) = (1,y)), but this is not significant. 

Let I'g(c) be the transversal s = 4, y =c on 00551 for the standard 
model vg in Q. The solutions of 5 in Q; define a homeomorphism ¢ of T(s) 
onto itself: follow the solution of 5 initiating at each point of T(s) around to 
the next intersection with T(s). A similar homeomorphism ġa is defined for 
T'a(c). Note that both ¢ and ġa define homeomorphisms of the compact seg- 
ment [0,1] onto itself such that the endpoints are fixed, but no other points 
are fixed. But it is easy to see that ¢ and ¢, define conjugate homeomorphisms 


of [0,1] (for note that the coordinate change t=ln — makes & on 


0<s<1 conjugate to an orientation-preserving, fixed-point free homeo- 
morphism of #* onto itself and so conjugate to a translation map r>r-+-1). 
Therefore we re-parametrize T (u) and T,(u) on 0& u< 1 so that the homeo- 
morphisms 5 and ¢ are precisely the same, as defined on the interval 
Susil. 
Now we extend the homeomorphism 
T (u) >T,(v) 

to a homeomorphism of Q; onto Q so as to carry the integral curves of ð onto 
those of va, the standard model. To perform the required extension each 
solution of 5 in Q; is mapped onto a solution of va having the same u-intercept 
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on T(w) or T,(w). For each solution § of 3 we measure the time duration 
T (u) between successive intercepts on T (u) and similarly we compute T',(w) 
for the corresponding solution Sa of va. Then points on S are mapped to 
points of 8, so that they correspond to the same proportions of the time dura- 
tions between successive intercepts with T(u) or T,(#), respectively. This 
construction proves that 5 in Q; as in case 1) is integrally equivalent to v, in 
Q, and the homeomorphism can be taken as + <> on the sides y = 0 and y == 1. 

For 5 in Q; in case 2) we can conclude, just as for case 1), that 0 is 
integrally equivalent to v, in Q. We next consider ð in Q; in case 3). We 
can assume that ¢=-—1 for y near 1 and = + 1 for y near 0. 

For v, in Q we construct the transversal 3,(#)on 06 <1 consisting 
of the circle y==4. For gin Q, we also construct a circular transversal 3 (0). 
To do this we take a segment y on the line L: z—$ near y—1 (in the band 
wherein ¢==—-1) between two successive intersections of a solution 8 of ï 
with L. Now we modify the upper end of y by sliding it back along & until 
we form a simple closed Jordan curve 2(#), 06 < 1, which is nonsingular, 
differentiable, nowhere tangent to ð. Also %(@) meets every solution of 4, 
other than y=0 and y==1, in exactly one point. We shall map @ in Qi 
onto v, in Q by mapping the solution 8 (9) of 7 onto the solution 9,(9) of v 
with the same 6-intercepts on 2(#) and %,(6). 

On the line L let f, be a segment between consecutive hits of 9(6) after 
leaving 2(9). Assume f, lies within the band wherein ¢=-—1 for 6. Every 
other solution of meets f, in just one point. Map the arc of 8(#) between 
the intercept with 3(#) and the first meeting with f, onto the corresponding 
arc of va, using proportional time durations to define the map. Map the arc 
of 3(6) following the first meeting with f, onto the corresponding arc of 
8.(0) by keeping the same z-coordinates for corresponding points. Map y == 1 
in Q; onto y= 1 in Q by zez. 

A similar construction maps the are of $(#) preceding the intercept with 
%(@) onto the corresponding are of S,(6). We perform this map for each 
S8(9) onto 8.(#) for 0S0 <1. Thus we obtain the required homeomorphism 
carrying 0 in Q; onto ve in Q. 

For 7 in Q; in case 4) we can conclude, just as in case 3), that ® is 
integrally equivalent to vg in Q. 

We finally conclude that v on T? is integrally equivalent to a C1 vector 
field von T*. Each of the N periodic solutions of 0 is along a longitude circle 
y = constant, and each of the annular regions bounded by a pair (or just 
one if N —1) of periodic solutions is filled by models a), b), c), or d) (or 
a model with ¢~»—7). These canonical forms for v on T°? show that there 
are at most 4% integral equivalence classes for v. Q.E.D. 
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It is easy to show that the bound 4% is not best possible, in fact 2-447 
is a bound as is seen immediately, but it seems difficult to find the best bound. 
Using Theorem 5 we can obtain special results for real analytic differential . 
systems v € V, (T?) on the real analytic torus T?. Of course the set V(O, 0) 
contains a continuum of non-equivalent analytic vector fields. But for Vo(d, 0) 
with d> 0, the following results are of interest. 


Lamma. A real analytic vector field v€V.(T*) on a real analytic torus 
T? either has a finite number of periodic solutions or else every solution is — 
periodic. 

Proof. If there were an infinite number of periodic solutions, then we 
investigate the behavior of v in the neighborhood N of a limit periodic 
solution. An elementary consequence of analyticity is that every solution of 
v in N is periodic. Examine the boundary solutions of N and note that each 
of these lies interior to a neighborhood filled with periodic solutions of v. - 
It thus follows that all 7? is filled by periodic solutions of v. Q.E.D. 


THROREM 6. On the real analytic torus T? = 8 X St, in each Uo(d, 0), 
for d>0, there exists precisely a countable infinity of integral equivalence 
classes which contain analytic vector fields. 

Proof. Let veV,(d,0) be analytic on T?. Then v has just a finite 
number NV = 2d of periodic solutions and so v belongs to one of 4% (or less) 
integral equivalence classes of Y(T*). By counting the equivalence classes 
corresponding to N==1,2,8,-- - periodic solutions, we obtain a countable 
number of integral equivalence classes represented by analytic vector fields in 
V.(d,0). Q.E.D. 

For structurally stable differential systems on the torus 7? the possible 
integral equivalence classes are rather simple. Note that a structurally stable 
system is always integrally equivalent to a real analytic system. 

THEOREM 7. A structurally stable differential system ve U.(T?) has a 
finite number N = 1 of periodic solutions. 


Proof. Ifv has no periodic solutions, then v is integrally equivalent to a 
linear system 
t=], ýj=À . (zand y mod1) 
with irrational A. However, even using a C1-diffeomorphism of T? onto itself, 
we can map v onto a differential system 
v: i=1, y= h(a,y) 


with h(z,y) in Ct on T?. The system v’ must be structurally stable and yield 
a rotation number of A, that is, the map of the circle z == 0 of T? onto itself 
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defined by the solution curves of v’ is conjugate to the irrational rotation of 
S* through an angle of rà. 
But for arbitrarily small « > 0 the perturbed system 


ver tml, ghey) te 


has a rational rotation number and hence a periodic solution. Thus v'e is not 
integrally equivalent to v’, which contradicts the hypothesis of structural 
stability of v. Therefore v has at least one periodic solution. 
Since v is integrally equivalent to a real analytic system on T°, the 
Lemma together with a consideration as above shows that v has only a finite 
number of periodic solutions on T?. Q. E. D. 


COROLLARY. There is just a countable number of integral equivalence 
classes which contain structurally stable diferential systems in V, (T>). 


It is easy to see that each 9%(a,6) contains a countable number of 
inequivalent structurally stable equations. One should note, however, that 
vE V(T?) can be integrally equivalent to a structurally stable system 
vE V,a(T?) and yet v, can fail to be structurally stable. This is possible if 
we recall that a periodic solution of a structurally stable system v must have 
a non-zero characteristic exponent. Then v, can have the same topological 
properties as v and yet have periodic solutions with zero characteristic 
exponents, cf. [7,8], and see Footnote 3. 

M. Peixoto has proved that the structurally stable differential systems in 
VY (T?) are dense in Y(T?), see [9]. 

We now turn to the problem of bifurcation of differential systems on T”. 
If v, and v, are in Y(T?), can they be joined by a continuous family of 
differential systems v€ Uo(T?) on J: 0SAS1 with only a finite number 
of bifurcation values of A€ J? Of course we assume v, and v, lie in the same 
component of V.,(T?), and it is no restriction to take this component as 
Vo (d, 0). 


THEOREM 8. On the torus T? = S$! X 8" let vo and v,€ Vo(d,0) for 
d>0. Then there eatsts a continuous family of differential systems 
wE VYo(d,0) for AET:0SA1, 
joining vo to v,, and such that vy has only a finite set of bifurcation values in I. 


Proof. Using the techniques employed in the proof of Theorem 5 we 
can decompose the integral curve family of v, on T? into a closed set filled 
by periodic solutions and a countable number of annuli Q, each integrally 
equivalent to one of the four standard models a), b), c), d) (and these with 
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t>—t), as discussed above. Since v, has no critical point on 7”, only a 
-finite number of the “horseshoe” annuli of types c) and d) can occur. The 
union of the finitely many closed annuli of types c) and d) is a closed set in 
T? and its complement is open in T?; it can be described by an open set on a 
meridian circle §1, that is, by a finite union of disjoint intervals I,,/,,° ‚Ir 
in St. 

Now define vy on OS ASF to be v, for A—0 and for A>0 define v 
by the integral curve family obtained from v, by narrowing each of the open 
intervals J., Ia} - +, Iy by linear contraction. At \==} each of the intervals 
I,,: > +, Ly is replaced by a single point which corresponds to a periodic solu- 
tion of v,,4. Then A==4 is the first bifurcation value of AEI, and viy 
possesses only a finite number of periodic solutions. Also v,,, has only a finite 
number of “horseshoe” annuli and if these are all of the type e) (or e) 
obtained by replacing # by —t), there are exactly 2d such annuli. Since 
d4>0, the vector field v,,, cannot consist entirely of annuli of types d) 
and d). 

We next show that if there is an annulus of type c) and also one of type 
d) in Viya then a continuous deformation v, with two bifurcations can reduce 
the number of d) annuli by one. For consider adjacent annuli of types c) 
and d), say, 

É = COS m 0Sısı 
y=y(y—1)(y—2) OS yS2. 





Now define the parametrized family on the two annuli, 0S2<1,0SyS2, 
by 

T == COS TY 

9=9(y—1)?(y—2) +y(y—2) (A—4) for ASF. 


But for à > 4 this differential system is integrally equivalent to an annular 
region of type b). Then again we deform v) to contract this b) annulus to a 
single periodic solution curve. Thus with two bifurcation values, we can 
extend the definition of », say to OS AS#, to obtain a system with one 
less d)-annular region than occurs in v/e 

In this way we can define u on OSAS $ so that v,,, has an integral 
curve family composed of just 2d annuli of type c) and c), which occur 
alternately in the cyclic ordering of the annuli around T?. In the same way we 
can define v on $A 1 which joins v, to the same standard model 11/2. 
Thus the total parametrized family v, on 0 SAS 1 has only a finite number 
of bifurcation values. Q.E.D. 

The problem of bifurcation for a continuous family va joining v to v, 
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in 9.(0,0) is more difficult and will not be analysed completely here. Of 
course if » is required to remain within the open subset Q of Y,(0,0) for 
which the classical rotation number is well-defined, then the bifurcation 
analysis is easy. For instance, suppose v, and v, in Q C Yo(0,0) have different 
rotation numbers and v, € Q for 0=AX1. Since the rotation number of vy 


is p 


(A), which is continuous in A, we find that p(A) must take on a non- 


countable number of modularly inequivalent irrational values. But this means 
that v, has a continuum of bifurcation values. 
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ON s-DISCRETENESS AND BOREL ISOMORPHISM.* 


By A. H. Sroxe.! 


1. Introduction. Throughout this paper, all spaces considered are to 
be metric. In [4] a start was made on the problem of classifying and charac- 
terizing the absolute Borel spaces under Borel isomorphism or generalized 
homeomorphism.? The main difficulty remaining was to find topological 
properties which are invariant under Borel isomorphism. It was shown that 
the weight of a space is one invariant; it is natural to conjecture that the 
local weight might be another, but this is not the case. In fact, an absolute 
Borel space can have arbitrarily high local weight and yet be Borel isomorphic 
to a discrete space (of local weight 1). However, we shall prove in the 
present paper that it will then have to be o-discrete;* in fact, o-discreteness 
is invariant under Borel isomorphism (Theorem 3, 3.4). This enables us 
to improve (Theorem 2, 3.3) the description of the hereditarily Borel sets 
given in [4, 6.2], and to complete (Theorem 6, 6.1) the Borel classification 
of the absolute Borel spaces of weight §i, started in [4, 5.5]. This last result 
depends on an auxilliary result which may be of independent interest. One 
well-known application of the axiom of choice is to assign to each countable 
limit ordinal a sequence of smaller ordinals converging to it; and such an 
assignment is itself a sufficient substitute for the axiom of choice in many 
applications. Thus it can be expected that there is no “natural” way of 
assigning such sequences of ordinals, and we confirm this by proving (Theorem 
5 and Corollary, 5.4 and 5.5) that no such choice of sequences can yield a 
Borel set in the space of all sequences of countable ordinals, in either the metric 
or the usual topology. We also deduce from Theorem 3 a theorem about 
continuous Borel isomorphisms of complete spaces (Theorem 4, 4.1). This 
will later permit a generalization of the theory to absolute Borel spaces which 
are o-locally of weight < k, k being an arbitrary infinite cardinal. It turns 


* Received July 22, 1963. 

* This work was supported by the National Science Foundation Grant NSF-G 19883. 

® A “ Borel isomorphism is a 1-1 mapping f such that both f and f take Borel sets 
into Borel sets. If further f and f alter Borel classes by at most fixed amounts, f is a 
“ generalized homeomorphism.” 

* See 2.4 below for an example. 

‘See 2.1 for the definition. 

* This is the only occurrence of non-metrizable spaces in this paper. 
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out that this property is also Borel invariant, and that the classification 
problem of [4] can thereby be solved; the author hopes to deal with this in 
a subsequent paper. The o-discrete case considered here is merely the special 
case k= No, but has to be dealt with first, as we need Theorem 4 for treating 
the general case. 

The terminology follows [1], in general; further terminology is as in 
[4], acquaintance with which is presupposed. In particular, the. letter k is 
used for an infinite cardinal. The “Baire space” B(k) is the product of 8, 
discrete sets each of cardinal k; B(N,) is the space of irrational numbers. 
The Cantor set is denoted by O (No). As stated above, all spaces considered are - 
to be metrizable; we use the symbol p for a metric on the space X, and. 
S(a,e) for the «neighborhood {y|p(z,y) <e} (e>0) of z in X. The 
diameter of a set E is written 8(£). 


2. Lemmas on 9-discreteness. 


2.1. We say (asin [3]) that a subset A of (metric) space X is relatively 
discrete if each point of A is isolated in A, discrete (in X) if A is closed in 
X and relatively discrete, and metrically discrete (with respect to a metric p 
on X) if it is e-diserete for some «> 0; that is, if c,y¢ A and z>£y imply 
p(z,y) Ze Each of these three properties may reasonably be used to define 
“o-discrete” ; fortunately it does not matter which we use, in view of the 
following leiit: 


Lamma 1. The following statements about a subset A of a space X are 
equivalent: 


(1) A=U {A,|n—1,2,- . ‘} where each A, ts relatively discrete, 
(2) A=U {B,|n=1,2,: > -} where each B, is discrete, 
(8) As=U {C,|n—=1,2,- : -} where each On is metrically discrete. 


Since metrically discrete> discrete > relatively discrete, it suffices to 
prove (1)> (3). From [3, p. 99], each An =U {Cam | m==1,2,- - -} where 
Cm is metrically discrete;.we merely renumber {Cm} into a single sequence 
{C,}. 

The first of these three properties depends only on A, and is a topological 
invariant of A. Thus a space A which has these properties for any one 
containing space X (e.g., itself) has them for all X; we call A “o-disorete.” 


2.2. Clearly if A is o-discrete, then so is every subset of A. We say 
that a space X is locally o-discrete if each point of X has a o-discrete neighbor- 
hood (which may be supposed to be open) in Z. 
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Lemma 2. If X is locally o-discrete, then X is o-discrete. 


This follows from a theorem of Michael [2, Th. 3.6(a)]. A direct 
proof, by using a “o-discrete” open refinement of an open covering of X by 
o-discrete sets, is also straightforward. 


2.8. Lemma 3. If fis a 1-1 continuous map of a space X onto a 
space Y, and D C Y is o-discrete, then so is f> (D). 


It is enough to prove that if Y is discrete then so is X. But, for each 
ze X, f(x) is open in F; hence {z} —f-1{f(z)} is open in X. 


2.4. An example. Before proving, in the next section, that o-discrete- 
ness is invariant under Borel isomorphism, we give a simple example to show 
that discreteness is emphatically not invariant. Consider B(k) =II{T, |n 
== 1,2,:--}, where Tẹ is a discrete space of cardinal k. For each n, pick 
a fixed element yE Tn, and put Em==set of all points z= (T1, ta - :) of 
B(k) for which ta = for all n > m, m—=1,2,:--. Write E =U {Em| m - 
== 1,2, > °}. Each Em is metrically discrete, in the usual metric on B(k),® 
so every subset of Em is locally compact. Thus every subset of E is an absolute 
F, (see [5]; alternatively this is an easy consequence of Lemma 1 above). 
Hence, from [4, Th. 12, 6.2], # is Borel isomorphic (by a generalized homeo- 
morphism of class (0,1)) to a discrete set of cardinal k (again this is also 
easy directly). But each non-empty open subset of E is arbitrarily far from 
‘being discrete. 


2.5. One final remark: it is easy to see (from Lemma 1) that a o- 
discrete space of weight k has exactly k points. In particular, for separable 
spaces, “ o-discrete”” &=> “ countable.” f 

8. Invariance of o-discreteness. 


3.1. The main step in the proof is the following lemma, which com- 
bines a previous theorem with a very special case of the theorem to be proved. 


Lemma 4. Let Y be an absolute Borel set of (additive or multiplicative) 
class a = 1, and of weight Sk. There exists a generalized homeomorphism f, 
of class (0, 9%), of a closed subset A of B(k) onto Y, such that 


(*) for each o-discrete E C A, f(E) is also o-discrete. 
Except for the last assertion (*), this has been proved in [4, Th. 4, 3.2]. 


€ Compare 5.2 below. 
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We shall follow through the argument there and verify that it also gives (*). 
It is enough, in view of Lemma 1 (2.1) to prove 


(**) If E is metrically discrete in A, then f(E) ts o-discrete. 


The argument in [4, 83] constructs A and f by transfinite induction 
over a, starting with the Gs case (multiplicative class ¢—=1). In this case 
(see [4, Lemma 3.3 and corollary|) f was shown to be of class (0,1); 80, 
since Æ is closed in A, f(E) is Gs in Y, and so is an absolute Gs. Thus we 
may give f(E) a complete metric. Let K be the perfect kernel (largest 
dense-in-itself subset) of f(E) ; if KØ, K would contain a homeomorph of 
the Cantor set O(N.) (see e.g. [1, p. 351]), which in turn would contain a 
non-Borel subset H; but then f!(H) would be a non-Borel subset of E— 
which is absurd, since every subset of E is closed. So K —@, and therefore 
[6, Th. 4] f(#) is o-discrete. 

The F, case is, for present purposes, covered by the Gs, case, so we 
proceed to the two remaining steps. 


(i) F of additive class a>1. Here Y—U;F, (n—=1,2,:-° :) where 
F,, is of multiplicative class < a, and the sets F,,F,,- - - are (pairwise) dis- 
joint; and the hypothesis of induction gives f,(An) == Fn where fn, An, satisfy 
the requirements of the present lemma. The construction in [4] makes 
Aw=U,(4, X n), and defines f so that f (an, n) ==fn(an) (n€ An). If E is 
discrete in A, we clearly have F=U,„(E„Xn) where E,„ is discrete in As; 
hence f(E) = Unfa(En) where each fa(En) is o-discrete. This shows that 
f(E) is o-diserete, verifying (**). 


(ii) FY of multiplicative class «>1. Here Y = N,„,Fn where F, is of 
additive class <a and where #, D F,D--.. The induction hypothesis gives 
F„—fn(An) as in the present lemma, where A, is a closed subset of a copy 
B, of B(K). The construction in [4] defines A to be the subset of IIs Bn 
consisting of all points a== {an} for which a,€ A, and f,(a,) = f(a) 
(n—1,2,:- +); and f is defined by: f(a) = fı(a). We must verify that 
(**) holds. In doing so, we may suppose that each A, has a metric pa 2”, 
and that A (a subspace of ]]„A„) is metrized by p, where 


(1) p (a,b) — È pn (an du). 


We introduce the following notation. For each positive integer m, the 
product AAXA2X ` `X Am is written P”; the infinite product IIs An is 
denoted by P. The projection of P onto A, is m»; the projection of P onto 
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P» (that is, m XmX' °° Xam) is written =”. Observe that these pro- 
jections, restricted to A, are all 1-1, because each «€ A satisfies a, = fr "fs(0s) 
(r,3=1,2, < -). We metrize P™ by p™, where 


(2) p (a,b) = È pnl ba). 


Now suppose F C A is ediscrete, e> 0. Then, if m is large enough, 
we clearly have from (1) and (2) that 


(3) a”(E) is metrically discrete'in P*. 
We shall show that (3) implies 
(4) m(E) is o-discrete. 


To do this, we use induction over m. The case m==1 being trivial, 
assume (8) => (4) for a particular m, and for all EC A, and suppose that 
w1(H) is a 8-discrete subset of Prt—PrX Amı. Write Er” =—q™ (E), 
Er — a" ( E) <= projection of #™* on P™ Let U be any open subset of P™ 
of p™-diameter < 8/2. We shall show that 


(5) UNE" is o-discrete, 
and as the first step in establishing (5) we prove 
(6) Tma (E N (U X Amıı)) is discrete. 


In fact, if Opi. and Gms: are distinct points of this set, there exist (unique) 
points b,c€ E such that bmi ==au1(b) and Cms = Tm (C). Thus (db) 
and m”"*!(c) are distinct points of «™*1(H), so by hypothesis their p™*?-distance 
is =ô; that is, from (2), p™(a™(b), m” (C)) + pr (Omir, Omir) = 8. But U 
has diameter < 8/2, so p™(a™(b), w™(c)) < 8/2. Hence pm (dm Cmi) = 8/2, 
proving (6). 

Now fmn sends discrete sets into o-discrete ones; hence fmummı (Em 
N (UX Am) ) is o-diserete. Let f” denote the (continuous, 1-1) map of 
a”(A) given by: f™(ds,° > *, am) = fi (t1) =' —=fmlam); then fra” co- 
incides with farm on Er*, and so fn” (Erin (U X Amin) ) is o-diserete. 
By Lemma 8 (2.8) it follows that r” (E= N (U X Amı)) is o-diserete; but 
this set is just ENT, so (5) is proved. 

From (5), #™ is locally o-discrete; Lemma 2 (2.2) now shows that Er 
is o-discrete and thus the union of a sequence of metrically discrete sets 
D(t), ¢—1,2,---. We can write E=U,D(i) where e™(D(t)) = D” (i). 
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From our induction hypothesis it follows that each m,(D(f)) is o-discrete; 
‘hence so is their union, m, (£). 

This proves, then, that (3) implies (4). Since (3). is true for large 
enough m, (4) must be true; but f, preserves o-discreteness, so finally f(E) 
=fim(E) is o-diserete, completing the proof of the lemma. 


8.2. Tesorem 1. For each absolute Borel space Y, one and only one 
of the following alternatives is true: either (i) Y is o-discrete, or (ii) Y 
contains a subset homeomorphic to the Cantor set O (Ro). 


Proof. Apply Lemma 4 to obtain Y =f (4) where A is closed in B(k) 
and f is continuous and 1-1 and preserves o-discreteness. Consider the perfect 
kernel K of A. If K==@, A is o-discrete [6, Th. 4], and therefore so is Y. 
If K4Q@, K contains a closed subset C homeomorphic to C(8,) [1, p. 351]; 
since O is compact, f | C is a homeomorphism, so that f(O) is a subset of Y 
homeomorphie to C(N,). Finally, (i) and (ii) cannot hold simultaneously, 
as that would imply that CO(N.) is o-discrete and so (from 2.5) countable. 


8.8. The preceding theorem can be used to improve a characterization 
[4, Th. 12, p. 26] of the absolute Borel sets which are Borel isomorphic to 
discrete seta. The results is: 
THEOREM 2. The following statements about an arbitrary (metric) 
space X are equivalent: 
(1) Every subset of X is an absolute Borel set. 
(2) Every subset of X is an absolute Fo. 
(3) Every Gs subset of X ts an absolute Fo. 
(4) X is o-disorete. 
(5) X is absolutely Borel, and is Borel isomorphic (or gaind homeo- 
morphic) to a discret set. 
(6) X is absolutely Borel, and contains no homeomorph of O (Ro). 
(7) X is absolutely Borel, and every separable subset of X is countable. 
(8) X is absolutely Borel, and for every ¥ C X we have | Ë | =| ¥ |. 
Proof. Since every o-discrete space is absolutely Borel (it is an absolute 
Fo by Lemma 1), the equivalence of (4) and (6) has just been shown. 
The equivalence of (1), (5) and (7), and the implication (7) > (8), were 
proved in [4], loc. cit. The implications (8)> (7), (2)> (3) and (in 
1 For separable spaces, Theorem 1 reduces to the well-known theorem (of Alexandroff 


and, Hausdorff) that every separable Borel set Y is either countable or contains a copy 
of O (R); see [1, p. 355]. . 
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view of Lemma 1) (4)> (2) > (1) are trivial. We must prove (1)> (4) 
and (38)> (4). Suppose that (1) or (3) holds but (4) fails. Then X is 
itself an absolute Borel set; hence, by Theorem 1, X contains a subset. homeo- 
morphic to C(8,). But this contains a non-Borel subset, contradicting (1); 
and it also contains a subset homeomorphic to the irrational numbers, contra- 
dicting (3). 


Remark. The generalized homeomorphism in (5) may be taken to be 
of class (1,0). In fact, from (2), every 1-1 mapping of X onto a discrete 
set will automatically be of class (1,0). It is interesting to contrast (3) 
with the “dual” statement that every F, subset of X is an absolute Gg; it is 
not hard to see that this is equivalent to saying that X is scattered, or equi- 
‚valently that every subset of X is absolutely both Fo and Gs, or that X is 
o-discrete and an absolute Gs; see [6, Th. 11] for further characterizations. 


3.4. As a corollary, the equivalence of (4) and (5) gives the Borel 
invariance of o-discreteness, which we state as: 


THEOREM 3. If an absolute Borel set X is Borel isomorphic to a o- 
discrete space, then X is o-discrete. l 


It may be worth calling attention to another consequence of Theorem 2 
(equivalence of (1), (2) and (5)): if an absolute Borel set X has a subset 
which is not Fe in X, then X has Borel subsets of arbitrarily high exact 
class (< w), and also has non-Borel subsets (and in fact non-analytic subsets, 
as the proof of Theorem 2 shows). It would be interesting to know whether 
this continues to hold without the requirement that X be absolutely Borel; 
and the same applies to Theorem 3. 


4. Continuous Borel isomorphisms. 


4.1. A continuous Borel isomorphism is, of course, continuous and 1-1, 
and it takes every o-discrete set onto a o-discrete set (Theorem 3). These 
are the only properties really required of the mapping f in the following 
` theorem, but we state the theorem in the more restrictive form in which it 
will be quoted in subsequent work.® 


THEOREM 4. Let k be an infinite cardinal and X a non-empty complete 
(metric) space in which every non-empty open set has weight k. Let f be a 


s Genuinely more restrictive, for it is easy to give an example of a continuous 1-1 
mapping f of a complete space X such that f preserves o-discreteness but is not a Borel 
isomorphism. (Roughly, take X to be the discrete union of separable spaces Xy, A < um; 
and arrange that f sends a Gg subset of X) to a subset of X} of exact class X.) 
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continuous Borel isomorphism of X onto an absolute Borel space Y. Then 
there exists a closed subset C* of X such that (i) C* ts homeomorphic to 
B(k) (or to C(&o) if k=), (ii) f(C*) is closed in Y, (iii) f | C* is a 
homeomorphism. 


Remark. This theorem resembles [4, Th. 5, 4.1]; but the hypotheses 
here are different, and the conclusion is stronger. In [4, Th. 5] the map f 
was allowed to be merely continuous; but it should be noted that here it would 
not suffice to have f continuous and 1-1 even if f(X) is complete. This is 
shown by the following example. Let fa: 7,21, (n=1,2,:  :) be, for 
each n, any 1-1 map of a discrete set Ta of c points onto a copy I, of the 
closed unit interval. Then the product map f—JJInf, is a continuous 1-1 
map of [],7,—B(c) onto the Hilbert cube J*, Every non-empty open 
subset of B(c) has weight c [4, p. 6]; but 7% does not contain any homeo- 
morph of B(c), since the weight of I* is only No. 


4.2. The proof of Theorem 4 is basically similar to that of [4, Th. 5], 
but the details are simpler here. We start an inductive construction by 
picking „EX, and writing U (co) = 8 (co, 1) == {x | 1E X, p(T, c) <1}, 
where p is the metric on X. We suppose first that k is not sequential; then 
the neighborhood 8 (co $) has, for some 7> 0, an ydiscrete subset E, of 
cardinal k (see [3, p. 100]). Now f(Eı) is o-discrete and therefore (Lemma 
1) contains, for some n’ > 0, an ’-diserete subset D, of cardinal ¥ also. Put 
Cı(co) =f*(D,). From C:(co) we omit any point whose distance from co 
is less than n/2, and also any point z such that p’(f(«x),f(0o.)) <7//2, P 
denoting the metric on Y; there can be at most one omitted point of each 
kind. To save notation we refer to the remaining set as Ci(c,) also; its 
cardinal is still k. Taking «,(c)) to be a small enough positive number, and 
writing U (c1) =S(¢1,«:(co)) for each c€ C,(c,), we thus obtain, for all 
C1, Cs" € Ci (Co), 


Ule) CU(e); 8(U(a)) <; H(F(U(a))) <4; 
if ¢, 54 ¢,’, then p(U (a), U (c) ) >eı(c,) and 
pP (f(U(e1)), F(U (6))) > (60) 3 pl, U(01)) > €1 (0) 5 
p (f (co), F(U (a"))) > (Co) s §Cr(co) |= %; elco) <4. 


We repeat the operation on each U(c,) (c,€ Cx(¢o)), obtaining a 
metrically discrete set Cz(c,) C U(c,) of k points, mapped by f onto a 
metrically discrete subset of FY, and neighborhoods (cz) == 8 (cz €2(¢1) ) 
(¢,€ Ca(c1)) at distances greater than «,(c,) from each other and from c,, 
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where 0 < e2(¢:) < e (co)/3, and such that the sets f(U(c.)) have similar 
properties. We put C,==U {C2(c,)| cı€ Ci(co)}, and repeat the argument 
on each U (cz)(c2€ C2); and so on. This achieves substantially the same 
set-up as [4, p. 17]; and the rest of the proof is essentially the same as 
[4, p. 18]; we here summarize it briefly, referring to [4] for the details. 
We consider all the “descendant sequences” ¢,¢1,°-*,G)° °°, Where 
GE Cil), t—=1,2,- - -; all of them are Cauchy, and so converge; we take 
C* to be the set of all limits of such sequences. It is not hard to see that C* 
is closed in X, f(C*) is closed in Y, f | C* is a homeomorphism, and C* is 
homeomorphie to B(k). 

If k is sequential, say k == sup 9, Pı < Pa <`- *, we modify the preceding 
construction. First suppose k > N; then we may assume p, > No We take 
E, to be of cardinal pa, and D, of cardinal pı; thus C(c)) will be of cardinal 
pı instead of k. Similarly we make each C,(c,) of cardinal pa, and so on. 
As in [4, p. 19], the resulting C* is still homeomorphic to B(k). Finally, 
if k=, the whole construction simplifies greatly; we take each C,(c.) to 
consist of just 2 points, and C* will now be homeomorphic to the Cantor set. 


4.3. COROLLARY. Under the above hypotheses on X, X contains a 
homeomorph of B(k). 


For apply the theorem taking Y =—= X and f = identity mapping. 


5. Sequences of ordinals. 


5.1. Consider the space S of all sequences of countable ordinals. For 
the present, we give the ordinals the discrete topology; thus 9 is just B (N1), 
regarded as [[,Q, where ©, is (for each n == 1,2,-- +) the set of all ordinals 
<w, in the discrete. topology; 8 is, of course, given the product topology. 
For each limit ordinal æ < w, “choose” a sequence b(a) = (81,82, - -) of 
ordinals &:,8:,° `- such that 3, <a and supaf,—«a. Consider the subset 
E == {b(a)| a a limit ordinal <w} of S. Our object is to confirm the 
feeling that there is no “nice” way of carrying out the above choices, by 
proving (Theorem 5 below) that E is never a Borel subset of S. The same 
result will then follow when we give the ordinals their usual topology (see 
5.5). In-what follows, all ordinals used are understood to be less than a. 


5.2. Lemma 5. E ts not o-discrete. 

We give S == B(N;) the usual metric in which p((t1, 2° © -), Wo Ya: © *)) 
—1/n when q; =y; for all i < n but m. Suppose F is o-discrete; then 
(Lemma 1, 2.1) E =U {D,|n—1,2,- - -} where Dy is e,-discrete for some 
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ts > 0. For each i=1,2,: -, put =U {Dy | > 1/4}; thus U, E; = E. 
We first show: f 


(1) Given fn Ba’ *,8% there are at most X, points of ‘E, beginning 
with (1, Bs ° *, Bi). 


For let P be the set of those points p€ F, which have the form 


P= (Bo Bo’ + t Bb Pus’ * *)- 


-Each p€ P is in some Dac) With nm > 1/1. Now if p,p’€ P and pep, 
then p(p, p) S1/(4-+1), and therefore n(p) n(p’), whence P is countable. 

For each ordinal « and each positive integer +, write F(a) == subset of 
FE, consisting of those points of E, whose first’+ co-ordinates are all Sa. 
We show 


(2) vach F(a) is countable. 


For there are at most N, possibilities for (f1,8s,° - <, pi) with Bu - +, fs 
all <a; and, from (1), each such possibility gives rise to at most N, points 
of E, 

For each p= (Bı, 82° °°) EE we write a(p) —sups8,; thus a(b(a)) 
= a for each limit ordinal a. We define a sequence a, < & <- - > of ordinals 
as follows. Take a@,— wo, say: When a, has been defined, we note that 
E,(a,) is countable, by (2), so we may define an ordinal yx (<) by: 
ya==sup{a(p) | p€ Ei(a,)}; and we take anı to be any ordinal greater than 
both a, and sup yn. This defines an increasing sequence {a,|r—=1,2,- +}. 
Let a*—= sup,a,; this is, of course, a limit ordinal (<,), so the sequence 
b(a*) = (8,*, Baf, + -) belongs to E, and therefore belongs to E, for some 
positive integer n. Further, we have max{f,*,: - -,8,*} < a*, and therefore 
<a, for some positive integer s. This means that b(a*) € H,(a,). By con- 
struction, therefore, a, > ym = 4(b(a*)) == a* > ay, giving a contradiction. 


5.3. Lemma 6. Every separable subset of E ts countable. 


Let C be any countable subset of E; say C == {b (am) | m==1,2,: - '}. 
Put a" —supm €m, and let F denote the set of all points of $ all of whose 
co-ordinates are <a*. Then F is closed in 8, so O (relative to E) C ENF. 
The map a | E N F.is a 1-1 correspondence between ENF and a countable 
set of ordinals (all = a*) ; so HM F is countable, whence C is countable also. 


5.4. Temorem 5. Hts not Borel (in 8), though every separable subset 
of E ts an absolute Fo. 
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For, if E were absolutely Borel, Theorem 2 (equivalence of (4) and (?)) 
would contradict Lemmas 5 and 6. 


_ 5.5. COROLLARY. Eis not Borel in Q», where Q is the space of count- 
able ordinals in the usual order-topology.® 


For the space $ above is O* with a finer topology. Hence if E were 
Borel in N%, it would be Borel in 8. 


6. Spaces of weight N. 


6.1. It was shown in [4, Th. 11, 5.5] that every absolute Borel set of 
weight N, is Borel isomorphic (and in fact generalized homeomorphic) to 
one of the following 4 spaces: (1) 8:B(1), (2) 8;B(1) + B(So), (8) BB (No), 
(4)B(8:). Here “-+-” denotes discrete union, B(1) is a 1-point space, and 
the notation k8 (where $ is a space and k a cardinal) means the discrete 
union of k copies of S. It was further shown that no two of these 4 spaces 
are Borel isomorphic, with the possible exception of (3) and (4). We can 
now complete the classification of the absolute Borel sets of weight N, by 
proving: 


THEOREM 6. NıB(No) and B(S8,) are not Borel isomorphic. 


Proof. Suppose, on the contrary, that f is a Borel isomorphism of 
R—8,B(N.) onto S=B(8,). Now R is the discrete union of N, copies 
By, (à < w) of B(N,). Consider the subset E of S which was studied in the 
previous section; write De=f*(#), D—=-DnB,. Thus f(D.) =f(B,)NF. 

Now B, is a separable absolute Borel set; hence [4, p. 20] f(Bı) is 
separable, and so f(D,) is a separable subset of E. By Lemma 6 (5.3) 
f(D,) is countable ; thus so is D) ; enumerate its points as {d\n | n € Ny}, where 
N, is a suitable set of positive integers (possibly finite or empty). For each 
positive integer n, put Fa = {dun |A<o.,n€ Ny}; then Fa is closed in R 
because it meets each By in at most one point. Hence DU, Fa is F, in K, 
and therefore f(D) must be Borel in S. But f(D) =F, which is not Borel, 
by Theorem 5; and this gives the desired contradiction. 


6.2. It would be interesting to know whether every subset of H is Borel 
in FE. If so, E would be an example of a space which is Borel isomorphic: to 
an absolute Borel set (in fact to a discrete set of N, points) without itself 
being absolutely Borel. | 


UNIVERSITY OF ROOHESTER, 
ROOHESTER, N. Y. 


666 A. H. STONE. 


REFERENCES. 


[1] C. Kuratowski, Topologie I (2nd ed.), Warsaw, 1948. 

[2] E. Michael, “Local properties of topological spaces,” Duke Mathematical Journal, 
vol. 21 (1954), pp. 163-172. 

[3] A. H. Stone, “ Cardinals of closed sets,” Afathematika, vol. 6 (1959), pp. 99-107. 











[4] , “Non-separable Borel sets,” Rospramy Matematycene 28, Warsaw, 1962. 

[5] , “Absolute F spaces,” Proceedings of the American Mathematical Society, 
vol. 13 (1962), pp. 495-499. 

[6] , “Kernel constructions and Borel sets,” Transactions of the American 


Mathematical Society, vol. 107 (1963), pp. 58-70. 


DUALITY AND RADON TRANSFORM FOR SYMMETRIC 
SPACES.* 


By S. HELGASON? 


1. Introduction. The classical Radon transform for the Euclidean space 
R” associates to each continuous function f of compact support the integrals 
of f over the hyperplanes in R”. If f is of class C® then it can be recovered 
from these integrals by means of a simple formula. This inversion formula 
amounts to a decomposition of f into plane waves, that is into functions which 
have paralel planes as level surfaces. A plane wave is just a function of 
one variable so the decomposition mentioned can sometimes reduce a problem 
for functions in n variables to a similar problem for functions in one variable. 

Now let 8 be a Riemannian globally symmetric space of the noncompact 
type and G==J,(8) the largest connected group of isometries of S in the 
compact open topology. The group @ contains maximal unipotent subgroups 
(all mutually conjugate) and their orbits in S are called horocycles. Each 
horocycle has dimensional equal to dim S—rankS. The space 8 of all horo- 
cycles in 8 is another homogeneous space acted on transitively by Œ and will be 
called the dual of S in view of the analogy with the projective duality between 
points and hyperplanes in R”. Although totally geodesic subspaces in $ are 
the closest analogy to planes in R”, the horocycles serve better in generalizing 
the Radon transform because S is a disjoint union of parallel horocycles. 
The “ polar coordinate” decomposition of 9 (Prop. 3.7) has an analogue for 8 
(Prop. 3.6). Moreover, if we consider the isotropy groups for the action of 
G on § and $, respectively, the orbit spaces of these isotropy groups have a 
dual structure (Theorem 3.8). The algebras D(S) and D($) of G-invariant 
differential operators on S$ and 9, respectively, also have similar properties. 

By analogy with the classical Radon transform, the Radon transform of a 
continuous function f of compact support on S is defined to be the function 
fon 8 such that for £€ 3, f(€) is the integral of f over & This mapping 
f— } is one-to-one and induces an isomorphism DD of D(8) into D(8) 
described in Theorem 5.8. On the other hand there is a natural dual to the 
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transform f—>f. This dual transform associates to a continuous function y 
on § the function y on S such that for pe 8, w(p) is the average of y over 
the (compact) set of horocycles passing through p. A natural problem is 
now to relate f and (?)Y. This is solved by Theorem 6.1 for the case when G l 
is a complex Lie group, the principal tool in the proof being the Plancherel 
formula for the group G. This theorem can be interpreted as a decomposi- 
tion of a function on § into plane waves. 

In § 7 the preceding results (G assumed complex) are applied to invariant 
differential equations on 8. It is shown that a differential equation Du == f 
where DED(S) and f is a given function can be reduced to a differential 
equation with constant coefficients on a Euclidean space (and is thus, in 
principle, solvable), The Euclidean space in question is a maximal flat totally 
geodesic submanifold of 8. In [18b] a different method is given, applying 
also to real G. l 

A short summary of this paper is published in [13a]. 


2. Notation. As usual, R and C denote the fields of real and complex 
numbers respectively. The identity element of a group will be denoted by e. 
If A is a group and B a subgroup the system of left cosets aB will be denoted 
by A/B. The subgroup B will, when viewed as an element in A/B, be denoted 
{B}. For each s€ A, the mapping aB—>zaB of A/B onto itself will be 
denoted +(x); the left translation a— za and the right translation a— ar 
will be denoted La (or L(x)) and Rẹ (or R(z)) respectively. If M isa 
topological space, C(M) (respectively, C.(M)) denotes the space of con- 
tinuous functions (respectively, continuous functions of compact support) 
on M. If L(M) is any linear space of functions f on M and D is an endo- 
morphism of L(M) then [Df](p) and sometimes D,(f(p)) denotes the 
value of the function Df at p. If M, and M, are two topological spaces and 
7 a homeomorphism of M, onto M, we put fr for the composite function 
fort. If M,—M,—WM and the maps ff? and ff" leave L(M) 
invariant we define’ D? by D’f= (Dft*)* for fe L(M). If Dt=D then D 
is called invariant under r. If M isa manifold, O” (M) (respectively C*.(M)) 
denotes the space of differentiable functions (respectively, differentiable func- 
tions with compact support) on M. If Dis a differential operator on M and 
r a diffeomorphism of M then D7 is also a differential operator on M. 

Lie group will be denoted by capital Roman letters and their Lie algebras 
by corresponding lower case German letters. The adjoint representation of a 
Lie group @ (respectively, Lie algebra g) will be denoted Adg (respectively, 
ad,). The subscripts are ommited when no confusion is likely. 
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8. The dual space of a symmetric space. Let S be a symmetric space 
(that is a Riemannian globally symmetric space), and let I,(9) denote the 
largest connected group of isometries of 8 in the compact open topology. It 
will always be assumed that S is of the noncompact type, that is I,(S) is 
semisimple and has no compact normal subgroup > {e}. The group J,(S) is 
generated by all products s,0s, where s, and 8, denote the geodesic symmetries 
with respect to the points p,q € 8. I£ we change the Riemannian structure 
on & to another one which is also invariant under J,(8) the geodesics remain 
the same, the geodesic symmetries sp are still isometries so /,($) remains the 
same. In view of this fact it is natural to choose the Riemannian structure 
as follows: For each pe 8 let K, denote the isotropy subgroup of G=—=I,(9) 
at p, let £, and 8o denote the corresponding Lie algebras and let pp denote the 
orthogonal complement of fp in go with respect to the Killing form B of gp. 
Then B is strictly positive definite on p, and the differential of the mapping 
g9>g'p of @ onto S induces a linear one-to-one mapping of Pp onto the 
tangent space Sp. The Riemannian structure on 3 is chosen such that this 
mapping of pp onto Sp is an isometry for each pe 9. 

Let } denote the rank of 8. Then § contains flat, totally geodesic sub- 
manifolds of dimension 7. Let us simply call these manifolds planes in 8. 
Now fix a point oe 8, let m denote the mapping g—>g-o of G onto S and 
let § denote the automorphism g— s.98, of @ as well as the corresponding 
automorphism of go. The Exponential mapping Exp at o is a diffeomorphism 
of So onto S. Let E be any plane containing o and let Hp, denote the (maximal 
abelian) subspace of vectors X€ po for which Exp(drX)EE. The sub- 
algebra hy, C go is often called a Cartan subalgebra for the space 8. Let K 
stand for the isotropy group K, of o and let A, denote the analytic subgroup 
of G corresponding to by. An element H € bp is called regular if its cen- 
tralizer in pọ equals bp. Let h's denote the set of regular elements in by. The 
connected components of h’,, are called the Weyl chambers in by. Select 
any Weyl chamber C in Hp. Then the dual space of Hp, can be ordered by 
calling a linear function A on hy, positive if A(H) >0 for all HEC. This 
ordering gives rise to an Iwasawa decomposition of G, G@—KA,N where N 
is a connected nilpotent subgroup of @ (see e.g. [13], Ch. VI). The Lie 
algebra tto of N is given by no = 2 Gor where for each linear function A on 


Bp we put gon == {X € go |[H, Z] —A(H)X, HE by}. l 
The group N depends on the choices of o, E and C. However, since all 


pairs (0,E) where o€ # are conjugate under G and all Weyl chambers C in 
Pp are conjugate under K it follows that the nilpotent subgroups of the various 


9 
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Iwasawa decompositions of G are all conjugate in G, i.e. all of the form 
gNg* (g€ @). 


Definition. A horocycle in 8 is an orbit of a subgroup of the form gNg*, 
g being any element in @. 


Remark. Identifying G with its adjoint group, the groups gNg" are 
the maximal unipotent subgroups of G ([1], [7], [17], [21]). Thus the 
horocycles in § can be defined quite directly, that is without invoking the 
Iwasawa decomposition. 

We shall now turn the set of horocycles into a manifold and study this 
manifold in some detail. First we introduce some notation. 

Let M and M’, respectively, denote the centralizer and normalizer of Hp 
in K. Let W denote the (finite) Weyl group M’/M. Let ho be any maximal 
abelian subalgebra of go containing p, let g denote the complexification of go 
and 5 the subspace of g spanned by ho. Then h is a Cartan subalgebra of g. 
Let A denote the set of nonzero roots of g with respect to bh and let by =) N fo, 
5*—)},,-+ thr All the roots in A are real on 5*. Let C* be any Weyl 
chamber in }* whose closure contains the Weyl chamber C in hy. We order 
the dual space of h* by means of the Weyl chamber C*. Then if & denotes 
the restriction to hy, of a root ac A then a >0Sa20 anda>0sa>0. 
The set A* of positive roots in A is a disjoint union, At=-P,U P, where 
a€ A* belongs to P, or P_ respectively according to whether &> 0 or &==0. 
Let pa 2 Now H € h’,, if and only if a(H) 40 for all «€ P,. The 
set {HE hy, «(AH )>0 for «€ P,} is therefore a subset of Hp, which is 
convex, hence connected, and contains C. Consequently 


C= {HE}, | «(H) > 0 for ae P,}. 
Lemma 3.1. Let H be any element in ©. Then 
(1) N m= {z€ G | lim exp (— tH)z oxp (tH) =e}. 
t-> o 


This lemma is presumably known (cf. [16]) but no proof seems avail- 
able. Denoting the right hand side of (1) by Nz the previous expression for 
no shows that N C Ng. The converse requires some matrix computation. 
As is well known (sec e.g. [13], p. 223) there exists a basis of g such that 
the matrices representing ad, have the following properties: 


ad(f,): skew Hermitian ; 
ad (no) : lower triangular with zeros in the diagonal; 
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ad(#n.): upper triangular with zeros in the diagonal; 

ad,(H) (Heb) is a diagonal matrix with diagonal M (H), à (H), > 
where ài, Àa’ ' - are all the roots of g with respect to 5 in increasing order 
(here the root 0 is counted with multiplicity dim). 

Now suppose ka€ Ny for some KE K, a€ Ay. Then 


(2) Ad(exp(—tH)k exp (tH) ) > Ad(a*) 
for t—>œ. Consider the matrices in (2), 


(3) (Ad (exp(— tH) k exp (tH) ))y = exp( (Aj — M) (tH) ) ky 


where (Ad(k) )i;== ky. Then it follows from (2) that ky==0 for i<j and 
ky > 0 for alli. But being also unitary, Ad(k) = e, so we find ka ==e; q.e.d. 


Lemma 3.2. (NO(N)) NK = {e}. 


Proof. Suppose n(n) € K for some n n€ N. Let Ade(n0(na)jy = ty 
in terms of the basis of g used above. Clearly u, = 1 and therefore uj = 0 
for 7541, the matrix (uy) being unitary. This implies Adg(6(n2))1;—=0 
for 5j>1. Hence u= 1 and ugy—0 for 7542. By induction we find that 
ty 84; 80 n0 (n) lies in the center of G. But this center lies in K and G 
acts effectively so the lemma is reduced to proving NN O(N) = {e}. This 
however is clear from the matrix representation already used. 


Lemma 8.3. The plane E is orthogonal to the horocycle N'o at o. 


Let qo denote the subspace of p, which dr maps onto the tangent space 
to the orbit N-o at o. This tangent space consists of the vectors dr(X) as 
X runs through no. Let X,€ qo, H € byo; then dx(X1) —=dr(X) for some 
X Eno Hence X, — X Ef, so B(X1,H) —B(X, H) =0, proving the lemma. 


THEOoREM 3.4. The group G acts transitively on the set of horocycles 
in 8. The subgroup of G which maps the horocycle N - o into itself equals MN. 


Proof. Let g,h € G and consider the orbits gNg*h-o and N-o. Writing 
hg = kan and using aNa+==N we find that AkN-o—gNgth-o so G is 
transitive. 


Now mNm! CN for each me M so MN is a group which maps No 
into itself. On the other hand let g € G be such that gV-o—N-o. Writing 
g == kan we conclude that kann, = k, for some n € N, k € K. Hence a= e 
80 kN'o=aN:-0. Lemma 3.3 now implies that Ade(k)ýp C By, that is, 
ke MW. Suppose kg M. Then the Weyl group element s = kM does not leave- 
C invariant so given H, € s70 there exists a root «€ P, such that «(H,) < 0. 
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Then the hyperplane a (H) = 0 in hw separates the Weyl chambers C and s*C. 
Select X 340 in no such that [H, X] —a(H)X for H € hp. Since a(s +H) <0 
for H € C we have Ad (k) X € 6(1to) so kNk N O(N) Æ {6}. But kN-o==N-o 
implies kNk"C NK so Lemma 3.2 gives a contradiction. Thus-k € M and 
Theorem 3.4 is proved. 

Since M is ompak and Ni is closed in G, the subgroup “MN is closed 
in G. 

Definition. The set of horocycles in S, with the differentiable structure 
of G/MN, will be called the dual space of S-and denoted by 8. 

Although the differentiable structure of $ involves a choice of o, E and 
C it is clear that a different choice only changes the subgroup MN into a 
conjugate subgroup g(MN)g and this gives the same differentiable structure 
on &, 

Let t y(t) (te R) be any geodesic in 8S. Let s, dadota the geodesic 
symmetry of § with respect to the point y(r) and put T= 8t/280 Then 
T,(t€ R) is a one-parameter subgroup of G. Its element are called transvec- 
tions along the geodesic y. Two horocycles £, and £, are called parallel if there 
exists a geodesic y intersecting é and é under a right angle and such that 
T(&) =é: for a suitable transvection T along y. If €€ 8, {é} shall denote 
the family of horocycles parallel to é. 


. Lemma 3.5. For a fived ge G the orbits of the group gNg" form a 
aaa family of horocycles. Hach paritat family. of ee arises in 
this fashion. 


Proof. Since @=NA,K each orbit of N intersects E. If a€ Ay, the 
orbit N- (a: o) equals aN -o which is parallel to N-o (Lemma 3.3). Since 
G acts transitively on the set {{é} | £E 8} the lemma follows. 

Consider now the set of horocycles which pass through o. In view of 
Theorem 3.4 this set is in a natural correspondence ‚with the coset space 
K/M, which again is in an obvious natural correspondence with the set of 
all Weyl chambers in all maximal abelian subspaces of po. 


Proposition 3.6. The mapping y:(kM,a)—>ka(N-0) is a: diffeo- 
morphism of K/M X Ay onto 8. 


Proof. Letke K and put £=k(N" ae since (kale) una“. o is parallel 
to é it is clear that the parallel family {£} can be written {kaN -o | a€ Ay}. 
Thus % is onto. Next suppose k,k,€ K, a,0,€A, such that ka,N-0 
—kza;N-0. By Theorem 3.4, (kea;)k,a,€MN and since aNoi—N, 
Ma’ — M (a€ Ay) we obtain k,7k,a,a,7¢€ MN so k,M—=k,M and a, — az. 
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Thus % is one-to-one. Now let mp denote the Lie algebra of M and let I, 
denote the orthogonal complement of m, in f, with respect to B. Consider 
the natural projections 


mi E>K/M, n: Q>G/K, #:@>6/MN 


and let r(x) be as described in Section 2. The differentials dr, and d# map 
Io and lo. Hy, respectively, isomorphically onto the tangent spaces (K/M) rto) 
and (G/MN)mro Let a€ Ay, ke K, HE}, Lek. Then for te R, 


y(k(exp tL) M, a) — ka exp(Ad(a*)tL) MN, 
(kM, aexp tH) —ka(exp tH) MN, 


dy, (dr (k) dro(L), dr(a)H) = dr (ka) (d#(Ad(a*)L -+ H)). 


The right hand side is £0 unless Ad (a) L -+ H € m+n. But this happens 
only if L=H==0 so y is regular and the proposition is proved. 
In comparison we recall the following well known fact. 


Proposition 3.7. The mapping p: (kM,a)—>kaK is a differentiable 
mapping of (K/M) X Ay onto 8 and a regular w-to-one mapping of 
K/M X A’, onto 8. 


Here w denotes the order of the Weyl group M’/M, A’p = exp h’,, and 8’ 
is the set of points in 8 which lie on only one plane through o. 

We shall now describe the double coset spaces K\G/K and MN\G/MN 
which of course can be regarded as the orbit spaces for the action of K on 
G/K and of MN on G/MN. Let Ay/W be the space obtained from A, by 
identifying points which are conjugate under W. 


THEOREM 3.8. The following relations are natural identifications: 
(i) K\G/K— A,/W ; 
(ii) MN\G/MN =A, X W. 


Proof. The first relation is well known and is proved as follows: Each. 
9g € @ can be written g = kiak, (kı, k€ K, a€ Ay). Lf g= kak is another 
such representation one finds by applying the automorphism 6, ka*k-? = (a’)?, 
where kE K. As is known (see e.g. [13], p. 245) this implies that a? and 
(a’)? (and therefore a and a’) are conjugate under the Weyl group. This 
proves (i). 

In order to prove (ii) we recall a result of Bruhat-Harish-Chandra [9] 
which identifies the double coset space MNAy\G/MN Ay, with the Weyl group. 
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More precisely, each g€ @ can be written 

(4) J = MaM Moln Ma (Mi, Ma E M, Nai, na E€ N, Gi, dg E Ay) 

where m,€ M’ is uniquely determined (mod M). Since M’A,(M’)* C Ap 
(4) can be written 

l (5) J = MN MAN Ma 


and (ii) therefore amounts to, that not only is m,M uniquely determined 
by g, but that the same is true of a. For this we need a lemma. 


Lemma 3.9. Let C and Œ be two Weyl chambers in by, and G == KAN, 
G—<=KA,N’ the corresponding Iwasawa decompositions. Then 


(NN’) N (MAp) = {e}. 


Proof. We first consider the case O’ ==— 0; here N’=0(N). Let m, 
n:E N, mE M, ae Ay such that 
(6) n0 (n2) = ma. 
Now we apply 6 and use ma=-am. Then 

H(n.)nanıd (nz) = M’. 

But m$(N)m"=#(N) so we get from Lemma 3.2, m?—6 and ngn, == 6. 
Let b denote the unique square root of a in Ay. Since m commutes with b 
we obtain from (6), b%n,0(m.71)b+=—=m, or sO(s*t)==m where s= bn. 
Writing s = (exp X)k where X € po and KE K it follows that m— exp 2X s0 
m? == e implies m =e. Now, in terms of the basis of g used earlier, Ada (n) 
is lower triangular and Adg(#(n,*+)) is upper triangular. Their diagonals 
are 1 and their product is (by (6)) a diagonal matrix. It follows that ny == e, 
so the relation (N6(N)) N (MAp) = {e} is proved. 

The proof of the lemma will be finished by proving N’ C N@(N). For 
each «€ A, let g% denote the root subspace 


g% = {Xe g|[H,X] —a(H)zX for all H €b}. 
Let P’ denote the set of roots in A which are >0 on O. Then if we put 
w = 2,8 the Lie algebra of N is we =n Ngo. If — P, denotes the set 
of negatives of the roots in P, it is clear that P’ C P,U (—P,) so 
w= Z ot 23 o | 


aePoP, aePoa(-P,) 


Taking intersections with go we obtain the direct decomposition 
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no == H] + Tle. 


Here n = 1o N no so it is a subalgebra of rn’. Now if 8, <ßB<'''<Pß 
are the roots in P’ in increasing order, consider the space 


n® = I of) A go - (lSkSp). 
EiS 


Then n® is an ideal in n'o [Wo n®] C nD, n® =n o and n® is the direct 
sum of its intersections with n, and tte. Using a result of [10], p. 736 we 
conclude that each n € N’ can be written n == exp X exp Y where X € m, Y € ne. 
Hence ne NO(N) and Lemma 3.9 is proved. 

Passing now to the proof of the theorem consider a second decomposition 
J = MNM nM, of the element g in (5). Now meotNmo =N for a 
suitable Weyl chamber C’. The lemma shows that a==a’ and the theorem is 
proved. 


4, Invariant differential operators on the space of horocycles. Let A 
be a Lie group, B a closed subgroup. Then D(A/B) shall denote the algebra 
of differential operators on A/B which are invariant under the action of A. 
We write D(A) instead of D(A/{e}) and sometimes we shall also write D(.9) 
for D(G/K) and D(8) for D(G/MN). As will be explained in more detail 
in the next section, the algebra D(8) is isomorphic to the algebra I(Hp,) of 
all polynomials on hy, which are invariant under the Weyl group. At present 
our problem is to analyze D($). For this purpose it is convenient to consider 
8 as a fibre bundle with base K/M, fibre Ay, the projection p: 8 K/M being 
the mapping which to each horocycle associates the parallel horocycle through 
o. The fibre Fy over the base point kM is the set {kaN -o | a€ Ay}. 

Now let U be a left invariant differential operator on the Lie group Áy. 
We carry this operator over on F, by means of the diffeomorphism a—> ka(N - 0) 
(a€ Ay) and obtain a differential operator Ur, on Fy. Now if fe C(S) let 
f | Fe denote the restriction of f to the fibre Fr. Consider the endomorphism 
Dy of C” (8) given by 


(1) (Dof)| F =Us(f| F), 


where F stands for an arbitrary fibre Fp. Now for each g€ G the diffeo- 

morphism +(g) of 8 is fibre-preserving. In fact it is geometrically clear 

that each isometry g of $ preserves parallelism of horocycles; analytically, 
(g) (kaN : o0) = kya,aN -0 


if gk— kına, 80 r(g) maps the fibre {kaN-o]a€Ap} onto the fibre 
{kaN -o | a€ Ap}. Let us now prove 
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(2) (Ur(°r(g))) or(g*) = Urigy-F($). (g€ @) 


for each fibre F and each ¢€ C*(r(g)-F). In view of the definition of the 
Ur, is suffices to prove (2) in the case when F = {aN -o | a€ Ap} and g maps 
F into itself. But such a g is necessarily of the form g = amn where a, € A, 
meM,neN. In this case, however, (2) reduces to the left invariance of U. 

The operator Dy defined by (1) is invariant under each g€ G; in fact, 
using (2) we have l 


(Dorf) | P= (Dof) | P= ( (Duf 0) | r(g2) -P)O 
= (Urar (PO | r(9)F))® — Ur(f | P) = (Dof) | F. 


Similarly, one proves that the mapping U-> Dy (U€ D(A,)) is a homo- ` 
morphism. It is clear that Dy is a continuous linear mapping of (*,(9) 

into itself (taken with the usual Schwartz topology) and that for each 

fe C”,(8) the support of Dof is contained in the support of f. Hence, by 

well-known facts (see? e.g. [12],.p. 242) Dy is a differential operator. It is 
clear since A, is abelian that D(A,) is men isomorphic to the sym- 

metric algebra 8 (bp) over Hy. 


THEOREM 4.1. The mapping U —> Dy defined by (1) is an isomorphism 
of S(By,) onto D(8). In particular D(8) is commutative. 


For simplicity, put H == MN and let o denote the point {H} in G/H. 
It G/H were a reductive coset space we know from [12], p. 269 that D(@/H) 
is determined by the invariants of the linear group dr(h) (hE H) acting on 
the symmetric algebra over the tangent space (G/H),. Although G/H is 
not in general reductive we shall nevertheless determine D(G/H) by means 
of the mentioned invariants. 

Consider the subspaces fo, Po, 1to, Dyo Bry Mo, Io introduced already and 
their respective complexifications, £, p, n, By, By, m, lin g. For each root sub- 
space g% («€ A) select a nonzero vector Xe € g“. Then 


(3) I= E Ceto), mht D (Hee), m=z o% 


Let o, denote the projection of go onto Io + $y, given by the direct decomposi- 
tion go = (lo + By.) + (mo -+ no). Let o denote the analogous projection of 
g onto I+ hy. Under the isomorphism 


dè: To + > (G/H) o 


‘Note that in Prop. 1 in [12] p. 242, the word “finite” should be replaced by 
“locally finite.” 
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the endomorphism dr(h) (hE H) of (G/H). corresponds to the endomor- 
phism oso Adg(h) of lo + Bp, (cf. [13], p. 367-368). In order to determine — 
the invariants of the group dr(h)- (he H) acting on (G/H), it suffices to 
determine the invariants of o,°Adg(H) on h+ bro or ae the 
invariants of oo Adg a ) on T+ Bp. 

Let a, > a>’ +> a, be the roots in P, in ee ee sae and put 
Ba==Xa +6Xa («€ P,). Lf H,":,Hıis a basis of by, the elements in 
the symmetric algebra S(I-+ hp) over I -+ bh, can be regarded as polynomials _ 
in Hy,---,H, Easy‘ t, Ea For each XEm-+n let d(X) denote the 
derivation of 8(I+ 5,) which extends the endomorphism oo ad (X) of I+ by. 
If a€ A, let Ha € § be determined by B(H,H«)=a(H) (Heh) and let a 
denote the root H->a({@H). Also put H’e—o(Ha«); if a€ P, then H’.540 
because H= bp + hy The mapping «&—>—-a® is a permutation of P}. Now, 
let a4,8€P, Then 


d(Xp) (Ba) =o([Xp,Xu-+0Xa]) —o([Xp, 0Xa]) — Ca o( [Xp, Zur] 
where (’a540. Since [g*,g“*] = CHa we have 
l if B>—a! 
CH’ if B=— af; here Cg340. 


d(Xg) Ea un 


Now suppose q € S(T + by) is invariant under co Adg(H). Then d(X)q=0 
for each XZem+n. We write q as a polynomial in Eae,’ - -,H#a, whose 
coefficients are polynomials in H;,: - -,H;: 


(4) q(A,- ° +, Ay Eag’ . Ea) =È Tr (Hi, s H) Bo,™- iu "Ea v, 


The derivation d(Xe,) annihilates each H, and all Ba,‘ - -;Ha, except one, 
say Fa, for which —aP=a,. Hence ; 


0 == d (Xa) g = (Canya) Xr (Hn: + H) Bam > t Ba > Ba,™, 


where $, ranges over those terms in (4) for which ny > 0. Since Ca H'a, 340 
the last equation shows that SY is an empty sum so Ha, does not occur in (4). 
Applying d(Xa,) to.(4) we see that Ea, (— a,’ — a) does not occur in (4), 
etc. Since «—>— a is a permutation of P, this proves that the right hand 
side of (4) lies in 8 (bp). 


Lemma 4.2. Let I(ls + $p) denote the set of polynomials in 3 (Io + Bro) 
which are invariant under co Adq(MN). Then 


I (to + Bp.) = 8 (byo). 
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It has been proved above that I (Is +5) C S(h,,). The converse inclu- 
sion follows from the fact that each Ad(m) (me M) is the identity on bp 
‘and that if ne N, then Ad(n)H==H(mod no) for each H € hpo 

Turning now to the proof of Theorem 4.1, let Lı, - -,L, be a basis of Jp. 
If a> 0 is sufficiently small, the mapping 


(tu > +5 pn) > exp (A +: + hi + bali +: + ++ tpl) E 
is a diffeomorphism of the cube |t| <a onto an open neighborhood V of o 
in @/H. The inverse mapping is a local coordinate system on V and the 
coordinate vector fields 9/84 satisfy 
(0/it)o—= 43 (Hi), (till), (SISLISj<p). 


Let De D(G/H). Then there exists a unique polynomial P in p +! variables 
such that 


© DAO -TPl og) OPH 4 tyke) H) (0) 


for all f€ C” (G/H). In the decomposition of P into homogeneous compo- 
nents let Pp denote the component of highest degree. The invariance of D 
of course implies 


(6) [Df] (0) = [Df] (0) (he H). 
Considering the highest order. derivatives in (5) one deduces fom (6) that 
Pp(dr(h) dê (H1), ` -,dr(h)di(Ly)) —Pp(d#(Hi),---,d@(Ly)) (heH), 


so Pp is invariant under dr(H). In view of Lemma 4.2, this implies that Pp 
is a polynomial in the basis vectors d#(H;),:- -,d#(H;) alone. Let P(D) 
denote the corresponding polynomial in H,,- - <, H, and consider the differ- 
ential operator Drp) defined by (1). Then, if fe 0” (G/B), 


(1) [Dewsfl(0) = PO (i 55) Hert +--+ Ath) H) 10). 


On comparison of (5) and (7) it is clear that D— Dp,p) is of lower order 
than D at the point o, hence of lower order everywhere, both operators being 
invariant. This proves, by induction, that every D€ D(G/H) has the form 
D = Dy for some UE S(hy,). Now by (1), 





[Dofl(0) = [0 (36) Hentai +: + HEAD] (0) 
(8) | 
= oe a vt) (f°) (expt H, aporna tH1))] (0) 
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for all U € S(p). This shows that the mapping U — Dy is one-to-one and 
Theorem 4.1 is proved. 


5. The Radon transform. Let £ be any horocycle in 8, dsg the volume 
element on £ in the Riemannian structure on é induced by 8. For f€ C,(8) 
we put 


1 £) = ds € 8. 
(1) He) = fit ae cea. 

Definition. The function f on 8 given by (1) will be called the Radon 
transform of f. 


It will be more convenient in what follows to express (1) in terms of 
functions on G. Let 


ai Q> Q/K, #:4G>G/MN 
denote the natural projections, and let 


The group N preserves the measure dsg, on the horocycle &=N 0; hence 
we can select a left invariant measure dn on N such that the mapping n> no 
of N onto & is measure-preserving. Then 


Ma) S fOe f Psd f f(gn-o)dn 


80 
(8) Plg) — f Pignan. 


PROPOBITION 5.1. The mapping f—f is a one-to-one linear mapping 
of O”, (8) into C,(8). 


Proof. Consider the mapping y of (K/M) X áp onto G/MN given by 
y (kM, a) = kaMN. Then i 


(foy) (kM, a) = Jzn) dn. 


Now FEe0°,(@) and the mapping (k,a,n) kan is a diffeomorphism of 
KXAyXN onto G Hence foye C*,.((K/M) X Ap) and since y is a 
diffeomorphism, f€ 0*,(8). Next, suppose f==0 and consider the function 


filg) = f Flag) dk, 
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where dk is the normalized Haar measure on K. Then f, is bi-invariant under 
K. Now let u be any function in C,(@), bi-invariant under K, and put 


F(a) —=.09tee) f u(an)dn, =... dedy 
N 


where loga is the unique element H in Hp such that exp H =a. Let v be 
any linear mapping of bp into C and- consider the corresponding spherical 
function 


$ (2) fr meer, 


where for each g€ G, H(g) is the unique element in dh, such that 
geKexpH(g)N. Then, for a suitable normalization of the invariant 
measure dr on G, 


A u(l2)ö,(0)de— Í. Fa(a)ottoeoda 


(see [11], p. 262). Now since f=0 we have F„—0. Then by [13], p. 410 
and p. 453 we conclude that f,==0. In particular, F(e) ==f(0)=—=0. Since 
(f7@))4 = (f) for each ze G, it follows that f=0 and the proposition is 
proved. 


Remark. The image of the space C*,(8) under the Radon transform 
is properly contained in 0*,(8). In fact, let $ be an arbitrary function in 
C*,(Ap) and consider the function DE C'*,($) defined by $(y(kM,a)) = $(a) 
for kE K, a€ Ay, where y is the diffeomorphism from Prop. 3.6. Suppose 
fe C*,(8) were a function such that f-——-. Since 6™=—@ and (f7)* 
== j"®) for all kc K we may, replacing f by the function p— ff(k-p)dk, 
assume that f is invariant under the action of K on 8. Since the function 
F, above is invariant under W (Lemma 17, [11], p. 261) we deduce that 
the function a— $(a)e-lose) is invariant under W. This is impossible, ¢ 
being arbitrary. l 

We shall now require a theorem which is essentially a restatement of some 
results of Harish-Chandra [11], (Lemma 3, p. 247 and Theorem 1, p. 260). 
Subsequently a diferent proof was indicated by Karpelevič [16]. 

I v is a linear function on 5, then e€ C”(hp,). For simplicity, the 
function a— (08a) on Ay shall also be denoted e”. 


THEOREM 5.2. The notation being as in the preceding sections, let 
D, (G) denote the set of diferential operators in D(G) which are invariant 
under all right translations from K. Then 
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(i) For each DE D(G) there exists a unique element Da€ D(A») 
such that 


D—D,€ nD (G) + D(G)h. 
(ii) If p€ C?(G@) such that (ngk) =¢$(g) foral nE N,g¢ G kek 
then 
(D$)- = Dag, De D(@), 
where the bar denotes restriction to Ay. 


(ii) The mapping D>eroDaoer is a homomorphism of D,(G) onto 
I(Bp,) and the kernel ts D,(E) N D(G)f,. 


In this connection we recall that a C” function f on a manifold can be 
regarded as a differential operator F— fF and that o denotes composition 
of differential operators. Also D(Ay) is canonically isomorphic to S(Hy)- 
Under this isomorphism, the unique automorphism p—’p of S(p) given 
by ‘H = H—p(H) (H€},,) corresponds to the automorphism D —> e? o De? 
of D(A). Statements (i) and (iii) follow immediately from the cited results 
of Harish-Chandra if we apply the anti-automorphism D>D* of D(@), 
D* denoting the adjoint of D. For (ii) one has to prove 


[DT$] (a) —[XD4] (a) =0 
for DE D(G), Teh, XE mm, aE Ay. But Tp=0 so DT ¢=0; secondly 
[£D$] (a) =lim 1/¢([D¢] (aexp tX) — [D$] (a)). 


t 
This expression vanishes since aexptXa*¢€ N, whence 


[De] (wexp tZ) = [ (Dp) Meew+00] (a) == [DE] (a). 


The factor algebra D,(@)/D,(G) N D(G)f is canonically isomorphic to 
D(G/K), (see [13], p. 432). In view of (iii) and Theorem 4.1 we have two 
isomorphisms onto, 

T: D(S)—>1 (bp), È: D(8) —> 8S (bp). 


THEOREM 5.3. Let’D(8)—='D(G/MN) denote the set of EED(8) 
such that 'T(E))E€I(bp). Let D— D denote the isomorphism of D(8) 
onto ’D(8) given by 


(2(B)) =r (D), | DeD(8). 
Then 


(Df)* =D? je 0” (89). 
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Proof. If a€ Ay, the automorphism n —> ana" of N has Radon-Nikodym 


derivative 
det(Ad(a)| n) = 6%? (eee) 
80 


(4) J paano f #(an)an, $ E0, (4N). 


The function F =f om and Ê — fo? are related by 


P(g) — f F(gn)dn 
80 
Ê (a) = errlocn f F (na) dn. 
N 


For g € G, let A (g) denote the unique element in by such thatg = n exp A(g)k 
for some ne NandkEK. Then the function F* given by 


F* (g) = 6-90(4@)) f F(ng)dn 
N 


satisfies F* (ngk) <= F*(g) for all g€ Q, n€N, keK. Let é denote the 
function g— e?r(AW) and as before let F — F denote the restriction of a func- 
tion on G to Ay. Then if Ee D(G) we have by Theorem 5.2 and (4) 


0) GBP] (na) dn. = [(E*)] (0) = [Be EÊ) (0). 
If EeD,(@) then the transform (EF)^ is defined and by (5) 


(6): (EF)*(a) = &*(a) [Ha(E(#*)-)] (a). 
Let D€ D(8) be determined by E (f or) = (Df) or for all fe C*,(S). Then 
T(D) —¢?oH,oe, by the definition of r. Hence, by (6), 
(DAME) = (BP) 6) = [(o*r(D) e) FY] (e) 
= [B(D) ((#)-)] (6) = LPF (&), 
the last equality following from (8) §4. Since (f7)== (f*)™ for all 
g € Gwe conclude that (Df)*(g-&) = LÖ} (g£) and the theorem is proved. 


Now let & denote the set of all linear functions on h,, which are restric- 
tions of some member of P,. Let 


Bom {A€ X | à/n é X for all integers n £1}. 
Let + denote the product of all elements in %. Each element s in the Weyl 
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group W induces a permutation of SU (—%) (see [13], Cor. 2.11, Ch. VII). 
It follows that m ==e(s)r where e(s) is a real number. But s>e(s) is a 
homomorphism of W into R so e(s)—==+1. Consequently =? is a Weyl 
group invariant. Since B is nondegenerate on Dp, we identify bp, with its dual 
and therefore S (Hp) with the algebra of polynomial functions on hy, Since 
B is invariant under W, I (Yp) is hereby identified with the algebra of W- 
invariant polynomial functions on bpe Let O denote the operator in D(S) 
which satisfies T(O) ==” and let Õ be any operator in D,(@) which goes 
into O by the natural homomorphism u of D,(@) onto D(G/K) ([18], p. 390). 


6. The inversion formula for complex G. Since the Radon transform 
f—? is one-to-one it is a natural problem to try to find an inversion formula 
for it. In this section such a formula will be proved in the case when the 
group I,(8) is a complex semisimple Lie group. 

In view of the duality between points and horocycles there is a natural 
dual to the transform f—> f. This dual transform associates to each function 
y€C(8) a function ý on 8 given by 


un) f yO mO, pes, 


where the integral on the right is the average of y over the (compact) set of 
horocycles passing through p. Select g€ @ such that g-o—p and as before 
let .==N-o. Then 


(9-0) = ff ¥( gk £) dk. 
Let f€ C.(8) and put I; = (f)Y. Our problem is to relate f and Jy. We have 


SS fr 80) dso) dk f S, f(gkn- 0) dn dk. 
For the function F=for we put 


In(g) = f, f Fon) an dk 


and of course we have Ir(g) =I;(g-0). 


THEOREM 6.1. Let S be a Riemanman globally symmetric space of the 
noncompact type. Assume that the group I,(S) has a complex structure. 
Then 

OI; = cf, fe C*,(8), 


where c is a constant =40, independent of f. 
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By assumption, the Lie algebra go has a complex structure, say J. In 
this case the decomposition go = fo -+ Jf, is a Cartan decomposition of ga 80 
po==Jt. For h we can now take the subalgebra bp, Jh of go so in this 
case bp = Jhr. Now, under the scalar multiplication (a + tb) X — aX -++ BX, 
Go is a Lie algebra over C and hp is a Cartan subalgebra. Let A’ denote the 
set of nonzero roots of go with respect to hy. For each a€ A’, let H’„ denote 
the vector in 5, such that B’(H’o,H) =a(H) (Hehe), B’ denoting the 
Killing form of go, considered as a Lie algebra over C. Then H’a€ Hy, and 
a is real valued on bp, ([13], pp. 220, 238). Fix a basis Ha: > +, Hi of By, 


l 
over R and for each root a€ A’ write H'a = X «tH. Here we define «>> 0 
=1 


i= 
if «x40 and « > 0 if j is the least index such that a? 340. Let Q denote the 
set of roots «€ A’ such that ay>0 and put =$ Da. For any complex 
aeQ 


i 
numbers aj == b; + tc; (LS j7S1) we put Bigs Salat tH) and 


a @ .80\ 8 ee 
(= u) a? db; +2); 


1 
6 
= J = 55 
Da 2 a day Da > 8a; ` 
The following formula is the principal step in the proof of the Plancherel 
formula for G: (see Gelfand-Neumark [6], Harish-Chandra [8], Gelfand- 
Graev [3]) 


(1) F(e) = 
clim II DeDa exp (p' (Hs) + (0 (He) )~) f F (k exp Hank) dndk. 
H>0aceQ KxN 


Here F is any function in C”,(G) and c is a constant 40 independent of F. 

Now regarding go as a Lie algebra over R we consider g, b, A as in $3. 
Then it is known (see [8], p. 513) that the relation between A and A’ is as 
follows: For each «€ A’ let a, and a. denote the C-linear functions on 5 idea 
that 


(2) a.(H)=a(H), a (H) = (a(H))- HE Yo 


the bar denoting complex conjugation. Then A consists of all «,, a. as œ runs 
through A’, Since each a€ A’ is real on Hp the set of restrictions of elements 
in A’ to Dp is the same as the set of restrictions of elements in A to by, Con- 
sequently there is a unique Weyl chamber in bp, say O, where all «€ Q are 
>0. A root «€A satisfies a>>0 if and only if a > 0 with respect to the 
ordering of A’ induced by C. Now we consider O*, A, P,, P_ and p, defined 
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in §3. Let ac A’. Since hn = Jýp and since a is complex-linear it cannot 
vanish identically on hy. From (2) we deduce then that P.—@ and 
P = {a8 | «E€ Q}. Now Ha—H,+H, where Hyc hy» Hoch. Each 
a€ A’ is real on bp and purely imaginary on hr. Hence by (2) 
(3) p (Ha) + (0 (Ea) ) -= 2p" (E) =p (E). 

Now suppose the function F in (1) is invariant under all right transla- 
tions from K. Using (8) we see that the expression inside the braces in (1) 
is equal to 


(4) aG f P (k exp Hyn) dkdn — erort) f. F(kbn)dkdn, 
KXN KXN 


x t 
where b= exp Hy =exp( >0,H;). Now, if ¢€C*(A,) and ®€ C*(R') 
j=l 
such that 
t 
$(b) = Alb, +, bi), en en 
then 
I 06 
[Wep] 0) I. 

j=1 ab; 

Hence we obtain from (1), (4), and (4) $5 


(5) F (e) = cs lim IL (H's) {0ta Í. F (knb) dk dn), 


where b>e in A, and cı==22c where p, as before, denotes the number of 
elements in P,. As earlier, let B denote the Killing form of gọ (as a Lie 
algebra over R). Since B is nondegenerate on Hy X Hp, we identity Hp, with 
its dual via B. Now B(X,Y) —2Re(B’(X,Y)) for X,Y € g so under the 
identification of hy, with its dual, H’. corresponds to 2a (a € A’) where & denotes 
the restriction of « to Jp, On the other hand, since a, and a have the same 
‘restriction to hy, the function r? from $5 coincides with II. This last 
product is therefore invariant under the Weyl group W aha are B is also 
invariant, the same is the case for the operator IL (H'a) € 8 (Hy): 
ame 


The function F, defined by 


F, (g) — J F (kng) dk an, gea, 


satisfies F, (ngk) =F, (g). s0 [DF] (b) = [DeF] (b) for DED(G) by 
Theorem 5.2. In particular, 


[OR] (b) = (DP (ero IE (Hla)*° 6) #1] (6). 


10 
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Hence by (5) 
(6) F (e) — clim [OF] (b). 


Now let z be a fixed element in @ and consider the functions Fe = fr@" or 
and F” given by 


Peg) = L Fe (kng) dk dn. 


Then (6) implies 
(7) F(z) = clim [OF.*] (b). 


Also, since 


Faa (g) = f (J F (ong) dk) an | 


we have 


[Are] (9) = f ( f [EF] (ekng) ar) an, 
because as g runs through a compact set in G, the integration can be taken 
over a compact set, independent of g. Now let gb and let b>e in Ay. 
Then, by (7) 


fa) = F(a) =e f S LOFI (een) at) an 


which, by [13], pp. 442-448, equals 
o f o Sr minci fl F(zkn) dk dn), 
N K KxN i 


where the subscript z denotes the argument on which Ñ acts. Since the last 
integral is Ir(z) it follows that 


f(e-0) —c[ Or] (2) = e[ODIr] (2: 0) 
and the theorem is proved. 


Remarks. The classical Radon transform in R” associates to each function 
FE C.(R”) the integrals of f over hyperplanes in R” and the problem of 
representing f by means of these integrals was solved by Radon [18] and 
John [14]. The definition of Radon transform on S is suggested by the 
analogy between horocycles and hyperplanes and the inversion formula in 
` Theorem 6.1 is analogous to the inversion formula of Radon-John for R” 
where n is odd. For n even the inversion formula is more complicated and 
involves an integral operator in place of a differential operator. Such com- 
plications are to be expected for S in the case when the group I,(S) is real. 


SYMMETRIC SPACES. 687 


The Radon transform for R* was generalized in different directions to 
Riemannian manifolds of constant curvature by Helgason [12], Semyanistyi 
[21] and Gelfand-Graev-Vilenkin [5]. In the case when & is the space of 
positive definite Hermitian n X n matrices a formula closely related to that 
of Theorem 6.1 was given by Gelfand-Graev [4] and Gelfand [2]. 


7. Applications to invariant differential equations. In this section, 
the group I,(8) will be assumed complex. We shall now indicate how 
Theorem 6.1 can be used to reduce a differential equation 


(1) Du=f 


where DED($), uel*(8), f€C*,(S), to a differential equation with 
constant coefficients on a Euclidean space. The procedure is reminiscent of 
the method of plane waves for solving homogeneous hyperbolic equations with 
constant coefficients (see e.g. John [15]). The heuristic discussion will be 
followed by a concrete example, carried out rigorously. 

For z€ G, kE K, a€ Ay we put 


Ux, (a) = Su taron o)dn, Fyo(0) -f f (zkan: o) dn, 
N 
ignoring convergence questions for the time being. Then (A (g) being as in 
§ 5) the functions 
Une (g) = eao f u(zkng-o)dn 
N 


Frat (g) = era) f f(zkng:o)dn 
N 


are invariant under each substitution g — ngk, and coincide with Uk, and 
Fro 00 Ay. Using Theorem 5.2 we deduce that 


(2) (erof (D) 0 @)U, a= Fi. 
Now by Theorem 6.1 
(3) f(z: 0) = fe f Faa(e)dk). 


This suggests the following way to write down a solution of (1): The function 
f being known, equation (2) is a differential equation with constant coefficients 
on the Euclidean space Ap. Assume now we have some “boundary condi- 
tions” such that (2) has a unique solution Ux,» depending continuously on k 
and differentiably on s. Then, as suggested by (3), a solution to (1) is 
given by 
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(4) u(z-0) = Bel Usel) dk). 


This will be verified below in a special case, where the stated assumptions are 
indeed satisfied. 


Ezample: The wave equation on S. Let A denote the Laplace-Beltrami 
operator on S and let f€ C*,(S). We shall write down a global solution 
of the wave equation 


Pu 


(5) Au = 7> (t= 0) 
with initial data 
(6) u(p,0)=0; {u(p,t)}eo—f(p) (pe8). 


Let | p|? =B (p,p) (under the identification of bp with its dual). Now 
the Laplacian A on 8 is induced by the Casimir operator in D(@) ([13], 
p. 451) and we see therefore from [11], Cor. 2, p. 271 that T(A) == Aa — | p |°, 
where A, denotes the Laplacian on A,. We are therefore led to consider the 
differential equation on Ay X R*, 


(7) (Ale) Vine Vin 
with initial data 

ð 
(8) Vong = 05 (nahm OF a2 


where Fwa is the same as above. The initial value problem (7), (8) is the 
Cauchy problem for damped waves on the Euclidean space Ay. The solution 
can be found in [19], p. 88 and we obtain 


(9) Frea) =f (Fy) (b) W (t, a, b) db, 


[log d-loga | St 
where 


Wt, a, b) = 24 (r | P | CAPET P | d) 


and d== (£ — | loga—logb |?) Here J, refers to the usual Bessel function 
and as before } denotes the rank of 9. The integral (9) is to be understood 
as its regularized value by means of analytic continuation as in [19], p. 88. 
As shown in [20], p. 35, V*,, is then a convolution (in the group RX Ay) 
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of a distribution (independent of k and z) and the function e*F,,.. It follows 
that V+,.(a@) depends differentiably on k and z and, as en by (4) and 
the fact that e° (e) 1, we consider the function 
u(2-0,) = cÑa( f V'n0(6) dk). 
K 


We shall now verify that this function is a solution of the initial value problem 
(5), (6). For this we need a lemma. Let A be an operator in D,(@) such 
that (A) == A, u being as in 85. 


Lexma 9.1. Let ae Ay. Then 
(10) Alf, Vipa (a)dk) = (ero Reo e)l f Vip .(a) dk), 
K K 


where A, is given by Theorem 5.2. 


It will first be shown that both sides of the equation (10) are solutions 
to the initial value problem 


(11) (up We We © @Z0) 
(12) m, [AW] (a,0) =el f (Fu) (a) dk), 


so the lemma will follow from the uniqueness for the Cauchy problem (11)- 
(12). There is no difficulty in verifying that the function 


(t, a) >Ä,( IRZROLD 
satisfies (11) and (12) so now let us put 
Wi,(a) = (eroäncer).( O dk). 
Then W°,=0 and 
[Wel (a0) = (0205n 8)a( È (Fre) (a) dk). 


In order to show that this equals the right hand side of (12) it suffices to 
prove that for each DED,(@), 


(13) | Dat J Prela) dk) = (e*? o Dao 67?) 4( J Paola) dk). 
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Since 


f Fpa? (g) PAD dk = f ( f fakng: 0)dk)dn 


we have 


ADD g( f Fye*(g)dk) = Í, (Del Í. f(alng-0)dk)) dn, 


which by [13], p. 443 equals 


SS. DT (cing: 0)dkydn— Dol f f, f(akng-0) de dn). 


Putting g=a€ A, we have by Theorem 5.2, 


errtoeDQ( | Frola) dk) — (Da) al f, Si f(ckna-o) dk dn) 


and now (13) follows from (4) §5. Finally (7) shows after a straight- 
forward computation that W's satisfies (11) so the lemma follows. 

Since (6) is an immediate consequence of (3) and (8) it remains just 
to verify (5). Using DA=AT and Lemma 7.1 we have 


Aa(u(a- 0,4) = ofle(Bo( f_V'ns(e)dk)) 
| = cÂ (e Bae) f Mradk] (€)), 
which equals 
(14) chel fi pa Tele) dk) 


as a consequence of (7) and the relation 6? o Aa o0 8° = Aa — |p |? already 
used. In (14) we can take 6°/0¢? outside the integral sign and interchange 
the two differential operators since they act on different arguments. Hence 
the expression (14) reduces to 


ai (u(v-o,t)). 


This completes the verification of the solution for (5) and (6). 
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EQUIVALENCE AND DECOMPOSITION OF VECTOR FIELDS © 
ABOUT AN ELEMENTARY CRITICAL POINT.*? 


By Kvo-Tsar CHEN. 


A critical point of a vector field X (i.e. an autonomous system of differ- 
ential equations) is a point where X vanishes. Assume that X == $ a‘(x)d/éz* 
is defined about the origin 0 of the real n-space B* with the coordinates 
z= (xt). A critical point p of X will be said to be elementary if each eigen- 
value of the matrix (da*/0r’), has nonvanishing real part. Our main results 
are summarized in the two theorems given below: 


TEEOREM OF DECOMPOSITION. If a C” vector field X has an elementary 
critical point at 0, then, in a neighborhood of 0, 


X=8 +N 
such that 


(a) Sand N are C@ vector fields with [8, N] —0. 
(b) with respect to a suitable O° coordinate system y, 
93217777 
iJ 


where the matris (cjt) is similar to a (possibly complex) diagonal matrix. 
(c) the linear part of N can be represented by a nilpotent matris. 


The above theorem yields a nonlinear analogy of the decomposition of 
a linear transformation of a finite dimensional vector space into semisimple 
and nilpotent parts as given by the Jordan canonical form. 


THEOREM OF EQUIVALENOR. Let X =>) a‘(x)8/det and Y = F, b+(2)d/dat 
be two O° vector fields having 0 as an elementary critical point. Denote by 
G(x) and B+ (2) the respective Taylor’s expansions of a*(x) and bt(x) in a. 
Then there extsts a C° transformation about 0 which carries X to Y if and 
only if there extsts a formal transformation which carries the formal vector 
field 3 a*(x)0/dxt to Dbt(2)d/Orr. 


This result reduces the problem of C° equivalence of vector fields about 
an elementary critical point to a formal and algebraic one. 


* Received June 20, 1963; revised September 27, 1963. 
1 The work has been partially supported by the National Sclence Foundation under 
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The theorems will be proved in three steps: First, a formal decomposi- 
tion of X is established. In the second step, a decomposed C@ vector field: 
corresponding to the formal decomposition of X is constructed. In the third 
step, we show that the vector field thus constructed is equivalent to X. 

In 882-3 we establish Lemma 3.1, which is a modification of Sternberg’s 
wedge method for diffeomorphisms [13], [14]. Our main aim at this stage 
is to show Lemma 6.1. § 4 gives us a necessary tool for dealing with estimates 
for vector fields. With preparatory work in § 5, we obtain Lemma 6.2, which 
enables us to complete the proof of Lemma 6.1 through Lemma 3.1. The 
third step of the proof of Theorem of Decomposition is therefore finished. — 

The first step is given in §§7-8. Instead of seeking a formal trans- 
formation ¢, under which two formal vector fields become equivalent, we look 
for a formal vector field Ê such- that 5 lies on the one-parameter group 
generated by Z. This device yields a more “Lie-algebraic” formal treatment, 
which turns out to be rather helpful. 

The second step (§§ 9-10). requires a further study of formal normal 
forms of vector fields so that the C” vector field constructed is decomposed 
and equipped with stable and unstable manifolds. The proof for the two 
theorems is finally completed in $11. 

It may be said that the central problem involved in this paper is the 
study of local behavior of solutions of an autonomous system of differential 
equations about an elementary critical point. The main qualitative result in 
this direction seems to be the existence of stable and unstable manifolds. For 
references, see [6] and [12]. The same result can be obtained ag a corollary 
of the main theorems of this paper. 

Another approach is to reduce an autonomous system to a normal form. 
The analytic case has been investigated by H. Poincaré, G. Birkhoff, C. L. 
Siegel and S. Sternberg. For references, see [15]. The corresponding results 
for the C” case turn out to be more satisfactory. Through results in diffeo- 
morphisms, Sternberg obtained a sufficient condition for an autonomous system 
to be C” equivalent to a linear diagonal system. See [2] and [13]. 

Our work is a continuation in this direction. We are able to remove the 
condition that the linear part of the vector field is diagonizable, which has 
been required in almost all previous works on normal forms under analytic 
or C” equivalence. 

It should be remarked here that M. Nagumo and K. Isé have given a 
sufficient condition for linearization under C* equivalence [9]. A recent 
result of P. Hartman [7] states that the 1-parameter group generated by a 
C* vector field about an elementary critical point can always be linearized 
under C° equivalence. 
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1. Preliminaries. Let m= (m,,' : ',m,) be an ntuple of natural 
integers. Let |m|—mit+---+m,. For any function f(x), write 


fi = 8/004 
and : 
fm == blif / 0a 
where 8l™/ôz™ — glml/(dat)™- - + (da")™. When |m |= 0, fm will be taken 
to be f itself. ` . 


Denote by F (D) the totality of functions of C” in a subset D of R”. For 
fEF(D), we define 


| f l-= |f la = supí] fn (p) |: pE D, |m | =r} 
and i j 


IF It loeti Te: = sn) 
We may verify by induction on r that f 


(1.1) PAESANI 


where Cw denotes the binomial coefficient. It follows that 


(1.2) fg es r ANI g Il 
For a C@ vector function f = (f*,: - -, ft) on D, we define 
TF =I Film = supll t llim t: 50. 


Lemma 1.1. For r=0, there exists a polynomial N, of degree r in a 
single variable and with nonnegative coeficients such that, for any f€ F(D) 
and for any Ct mapping & from a subset D of R! into Ð, 


foo Ils Nle e [ltl fl 
where ||| fog ||[p—=||[fo¢|||na will bs understood. 
Proof. The case r— 0 is trivial. For r> 0, we have 
Moe) (ro) (Pe 4)s 
and 
Foelas rE llog [lh Ml] ee [lle 
Hence the lemma follows from the induction hypothesis. 


Lemma 1.2. For r= 0, there extsts a polynomial M, of degree.r in . 
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two variables and with nonnegative coefficients such that, for any f€ F(D) 
and for any two Or mappings œ, y from D into D, 


\|fou—fed lll- Sal fl lroy— zog lr 
+M (\|]2°9 [Ilo [I] 2o¥ llkoll llrey — zes lll 


provided D is arcwise connected. Moreover Mo = 0. 
Remark. The lemma holds equally well for a vector function f. 


Proof. We use induction on r. The case r ==0 follows from the theorem 
of mean. For the case ++ 1, 
(foy—fod)i— ZL (Acy) (2\oy—arog);-+ (frow—frog) (Rod); 
and 


(1.3) Ifey—Feo)l-S A row ZI I Zn ara 
TEIAS — fro > li ll (20 p) lr}. 


Here 
liey oS If lls, 
fro Des Na(||| oor || Ir) I] Ie 
Karoy— Rod) la S | r04 — ro g rae 
Moreover 


Ihoy—hoshkzsllihev—heellle 


for which the induction hypothesis applies. Therefore the right side of (1.3) 
is not greater than an expression of the type 


nef lls leoy— eog lra +M ||| F || Ira ||| eo¥—2°$ ||| 
where M,,, may be further adjusted. Hence the lemma is proved. 


2. Diffeomorphisms with stable manifolds. All diffeomorphisms and 
vector fields mentioned hereafter will be of O° unless otherwise specified. By 
a local diffeomorphism about 0, we always mean one which leaves 0 fixed. 
Denote by J(T) the jacobian of such a local diffeomorphism T at 0. If 
J(T) has no eigenvalue of absolute value 1, then the fixed point 0 of T will 
be said to be elementary. 

Let T be a given local diffeomorphism about the elementary fixed point 0 
such that it possesses an unstable manifold V* and a stable manifold V-. 
Suppose that V+ and V- happen to be two linear subspaces of R” such that 


Rr= F" V. 
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We may assume that the set {1,- - -,n} is the union of two disjoint sub- 
joint subsets $, and X. such that 


(a) each element of X, precedes those of S, 


(b) V* is given through the equations zt = 0, i€ X; and V-, through 
the equations zt =0, tE X. 

We may further assume that X, is not empty. Write st — (zt) ieg, and 
T = (Tt) eg 80 that s= (s+, r). 

Let 7,: R”—> V* and m: R”— V- be the projections. Let J,(T) be the 
restriction of the jacobian J(T) on V*. Similarly we define J_(T). 

Denote by B the quadratic form $ (z*)2. There exists a positive integer 

de; 
l such that 
B(J,(T)*p) = 2B(p). pe vt. 


Define Q, to be the quadratic form such that 
Qs—=B4BoJ,(T) +: -4+BoJ,(T)¥, 
which is positive definite on V+. Moreover 
Q.°F,(T) —Q,—BoJ,(L)!—B 


is also a positive definite quadratic form on V*. Similarly we construct a 
positive definite quadratic form Q_ on V- such that the quadratic form 
Q-°J_(T) —Q_ is negative definite on V-. 

Define 


Y(t) = Q.(2*) + Q-(r). 


Then Q is positive definite in R”, 
For pe R”, we define 


l2(p) | =Q(p)4, 
| z (p) ll = Q. (p)4, 


| z (p) ll- = Q- (p)Ż. 
Write, for p > 0, 


Sp={p:llz(p)Il <p}, 

Spt—= {p: | 2(p) |= l e(p)l-} NA Sp 
B= {p: | e(p) lS e) -}N S 
Be = {p: | 2(p) l= I 2(p)l-}N Sp. 


Note that, in Sp*, 
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Let U be another local diffeomorphism about 0 such that J (U) == J (T). 


Lemma 2.1. There exist positive numbers po, a, B witha<B<cl such 
that, in Spo*, 


(2.1) alelasjeP—leeTtlesplels 
(2.2) alelesSeoU je — ler sßlels 
(2.8) ajel2<|2oT?|2—[2|2SaAl e 


Proof. Since Q,°J,(T) —Q, and Q.—Q.oJ_(T) are positive definite 
on V+ and V- respectively, there exist positive numbers « and 8’ such that 


ABI REST EZ EZ DH Fe lel, 

æ eles rod (T) elele Sg lols, 

# e2 S lroJ (T) |2—lel? Se |e. 
All we need to show is that, in Spot for some po >0, 
(2.4) | zo T 12 — 12° /NP=o(lel?), 





(2.5) (z200 le—1z0/(T) [= cou è — lro (0) = od 2 |’), 
(2. 6) col? |*—|roJ(T)*|2—o(] |). 


Since, in Spot, o(|z |) = o(|| z |”), we have immediately (2.4) and (2.5). 
Observe that 
leo T= |*—] eod(L)> 1- 


vanishes on V* and has vanishing linear terms. Hence (2.6) also holds and 
the lemma is proved. 


Remark. Since po may be arbitrarily small, we demand that T, T- 
and U are defined and of C in the closure of Spo with po < 1 and that the 
inequalities analogous to (2.1), (2.2) and (2.8) hold in Spo. 


ÜOROLLARY 1. In Spot, 
a—-plePSsIe ls (1e) e l, 
(14a)fef2S|ooT jS (1+8) e l 


COROLLARY 2. If pı— po/2 and pE Spt, and if lis the least positwe 
integer such T-'p ¢ Spot, then 


ie (Tp) |- > | (Tp) f+- 
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Proof. Since 
[2(T'p) 2S (1— a)! (p) < py 
the inequality || æ(T-1p) |- £ | 2(T-tp) |, would imply 
| z (T=1p) |? < 21? < po? 
which is absurd, Hence the corollary holds. 


For pE Spı* (or p€ Spy), define k(p) to be the least natural integer 
such that 
T¥Or+p E Spo* (or T##)*1p ¢ Spo). 
When p lies in V* or V-, we set k(p) =œ. We leave &(0) undefined. 
Write k—k(p). We have, in Spt — V+, 


(1—8)* | ¢(p) 4S IST) PS (1—a)* | 2(p) 1.3, 
(1+ @)*] 2(p)|*S | e(T*p) 3S (14 8)* J 2(p) 1, 


and 
| (Tp) |-S || z(T*p) |. 
Thus we obtain : 
(2.7) | @(p)l-*/|| (DIS (1—a@)*)/ (1 + a); 


Lemma 2.2. There exists a positive integer k, and a positive number 
&<1 such that, for k(p) > ko DE Spt, 
12°7*1<ele]. 
Proof. Choose A>0 such that 
che (1—a) HA(1 +8) <1. 


It follows from (2.7) that there exists k, such that k(p) > ko implies . 
l 2(p)|]-*/-2(p) | Sa. l 


Hence - 


[zota PSfcol|2+ sol 2S (1—a) jeh + (1+8) zl 
= ((1—a) +A (1+ 8)) le |S e |a j. 


3. Main lemma for local diffeomorphisms. For any function f defined 
in Sp, denote by |||f |||- the Cr norm ||| f'||I,p over Sp. If f is not of Or 
at some points of Sp, then ||| f|||-r will be understood to mean the Or norm 
over Sp excluding those points. 
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Lemus 3.1. Let T be a local diffeomorphism about the elementary 
ficed point 0 such that it possesses V* and V- as its unstable and stable 
manifolds, where V+ and V- are linear subspaces of R” with R" = Vt @ V-. 
Let U be a local diffeomorphism having contact of infinite order with T at 0. 
Let R” be normed as in $2 such that the integral valued function k(p) may 
be defined about 0. Let there be given a local homeomorphism o, about 0 
having contact of infinite order with the identity mapping at 0 such that 


p when | 2(p)[.—~ l 2(p)l- 
op=2UT*p when |'2(p)|.> | e(p)l-*(p) > 9 
U*Tp when | e(p) |. < | e(p) | #(p) > 0. 


It is further assumed that o, is of C° about 0 except at some points p with 
either Tp or Tp dying on the cone |z|.=1el- Then, given pi > 0, 
there exists ps > 0 satisfying the following conditions: 


_ (a) The local homeomorphisms os from Spa into Spuy k > 1, given by 


Okap when k(p) <k—1 
= UoxsT*p when | c(p) | > | e(p)l#(p) 2-1 
UonsTp when | 2(p)|+< | 2(p) | #(p) = &—1 


are well defined. 


(b) For r—=0,1,° + > and for s arbitrarily large, there exist K,(r) >0 
with 
||| tocx—2 || |ro S&s(r)e* 
for ke1,2,°° ° and 0<p< ps. 


(c) {ox} converges uniformly to a local diffeomorphism o over some 
neighborhood of 0 such that l 


U 0To! 
about 0. 


Proof. We adopt the notations in §2 including the choice of pı. Each 
local homeomorphism o; may be defined individually over a sufficiently small - 
neighborhood of 0. If ox is well defined in Sp2, then it will be of C? in Sps 
except at some points p with either T*p or T*p lying on the cone || z |+ = | 2 [-. 

Let k, and c be given as in Lemma 2.2 and let N,, M, be given as in 
Lemmas 1.1 and 1.2. Since U and T have contact of infinite order at 0, 
we have 


[|| co (UT) —2|||rp S Qa (r)e, O<p<p, 
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where Q,(r) is a positive constant. 


We shall prove (a) and (b) by double induction on r and k. For 
simplicity, we shall carry out the induction step only in Sp,*. First we require 
p2 to be so small that (a) holds for kSk,+1. Write 


N,—N,(|||2° T || |r.) 
and 
L(r) =nN, || zo U ihip. 


Let l= I(r) be a positive integer such that L(r)c! <1. If r= 0, there exists 
K,(r) > 0 with 
||| toox—2 || [rp S Ea(r)p* 


for kS ko +1 and p<p: Adjust K,(0) such that 
(3.1) K,(0) > L(0)c*K,(0) + Q,(0), s21(0). 


Write M, = M,(1,Ko(r)) and C(r) =N,M, | 2oU lp. For r>0, 321, 
adjust K,(r) such that 


(3.2) | Kr) > L(r)ctK,(r) + C(r) eK. (r—1) + Q,(r). 
Adjust Psa such that pe < pı and 
(8.3) |zt(p)| < (Kro (0) +1) pa, el, ',n, 


implies p€ Sp. Write 
Ds =S N {p: k(p) Zk}. 


It follows from Lemma 2.2 that, for k> k, and p<py 
T AD: Cc Sop*. 


Consider now the case (r, k +1) with r= 0, k= ko+1. It is clear that, 
in Dy with p < ps, 
Ore = Uog Tt 
is well defined. Moreover 
Ion. —2 || [ros S ||| 2° (UT) —20 (UTA) ||la 
+ ||| 2° (OT+) —2 |||. 
It follows from Lemmas 1.1 and 1.2 that _ 
II| 2° (IT) a0 (UTH) ||| £ N, ||| (2° 0) 00—200 ||| 
S L(r)|||z°0ox—z || |rop +0(r) ||| toox—2 || liop. 


11 
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Owing to (3.1) and (3.2), we obtain 


||| eo —2 || [ros £ LL (r) Ka (r) e + O(r) Ka(r—1) 0° + (r) le 
SK, (r). 


Since opp = op for k(p) <k, we conclude that (b) holds for ozs. 
For 1=1(0) and for pE Spt, p < pa- 
| zi (op) | S| 2t (orp) —2*(p)| + | 2*(p)| 
<= K,(0)p'+ p< (Ki(0) +1) pz 


Thus, by (3.3), we have 


Ox41P € Sp. 
Thus (a) also holds. 


It may be easily verified that 


Uro Tp for k(p) <k 
arp I for k(p) =k. 


Write g=Tp. Then k(g)—k(p) +121. We have, for k(p) <k—1, 


oxl'p _ okq = Udo, T *Og 
= URN TRO p om Uoxp 
and, for k(p) 2k—1, 
oT p = ong = U*T-*q = Uor-sp.- 
Define 
l H (c) = z0 (Uc) — zo (oT) 
and rk: Sp, > R" such that 


TO Te = TO Oka — TOG. 


Then 
. 0 for k(p) <k—1 
H (ox) = = (Uor) —zo (Uor) for k(p) =k—1 
and 
PATR j 0 for k(p) <k 
re (ao (UT) —200,=H (ox) T> for k(p) =k. 
Set 
M*, —M,(Ko(r), Ko(r)). 
Then 
(3.4) ||] eo rw || [eo = ||| 207r lllo ||| # (oe) || [rep 


and 


\ 
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IN llle En ||| 2° T liho llor lllo 
(3.5) + MS, |||200 Illo || #27 Ilea 
S L, ||| zore II lr 


L, being a constant independent of k. It is clear that, for p sufficiently small, 
there exists B,(r) > 0 such that 


[|] 207 [lee < Bun). 
Applying (3.4) and (3.5) -recursively, we obtain 
||| tore || |p S (NrLro)#*B(r)p* 


and 
i H (or) Ie S < L,(N,L,c*)**B, (r) p*. 
We may take s such that 
N,L,0 <1. 


Hence o is of C” about 0 and U=0To”* and the lemma is proved. 


COROLLARY. For T and U given in the preceding lemma, there always 
ecists a local diffeomorphism o about 0 such that U=oTo! about 0. 


Proof. The existence of a local homeomorphism o, as required in the 
preceding lemma is assured through Whitney’s extension theorem [16]. 
Hence the corollary follows. 


4, Lemmas on matrices. Denate by Dt the totality of n X n matrices 
over R. In this section, we shall take R” as the totality of n X 1 matrices 
over R. For HEM, define 


| H |= sup{] He |: | z | =1,2 € Br}. 


LEMMA 4.1. Let x(t) and u(t) be Rr-valued functions continuous over 
a compactum X such that x(t) never vanishes. Let M>0. Let H(t) be an 
M-valued function over X with | H{t)| <M over & such that 


H(t)z(t) =u(i), . te &. 


Then there exists an M-valued function B(t) continuous over & ‘with 
| B(t) || << and 
B(t)z(t) u(t), te &. 
í 
Proof. Write s= (zt), u= (ut) and H = (hf). For any t€ %, we 
may construct 


H (to, t) ere (hg (bo, t)) 
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continuous in a neighborhood U(t,) of to such that 
H (to, t)«(t) u(t), 
and 
H (to, to) == H (to). 
In fact, one of z*(t,), says, z*(t)) does not vanish, and we simply set 
hjt (to t) = hj (to) for 7 > 1 and 
bad 
hat (to, t) = a> (t) (u+ (t) — D hit (to) 2+ (4) ). 
Using the compactness of &, we may thus find a finite open covering 
B e +, 8%, such that, for each t—1,---,r, there is an Yt-valued function 
B,(t) continuous over V, with | B,(t) | <M and B;(t)z(t) u(t) over B. 


Let {&(t)), 1=1,: + -,7, be a partition of unity over & such that ¢,(¢) is 
continuous and non-negative over X and vanishes outside of Bı. Set 


B(t) =S AHB). 


Since > ¢;(¢t) ==1, B (t) meets our requirements. Hence the lemma is proved. 


Lemma 4.2. Let E be a closed interval. Let x(t), u(t), H(t) be 
defined as in the preceding lemma, except that x(t) may vanish somewhere 
in &. Then there exists an M-valued function B(t) integrable over X (in 
the Lebesgue sense) with || B(t)|| <M and B(t)z—u(t) almost everywhere 
in Z. 


Proof. Denote by Æ, the subset of X over which z(t) does not vanish. 
Then &, is open relative to &, and there exists a sequence of disjoint open 
intervals (a, b1), (as, b3),- - - such that 


(a) Xo— U (a, bs) is of Lebesgue measure zero, 
iz 
(b) [a,b] C ¥o,t—1,2,---. 


It follows from the preceding lemma that there exists B,(t) defined and 
continuous over [a bı] with | B(t)|| <M and B(t)z(t) =u(t). Define 


B(t) == B,(t) for tE (a, bi) 
and B(t) —=0 for tE E— L (a, bi). 


It is clear that B(¢) has the required properties. Hences the lemma is proved. 


Lumma 4.3. Let x(t) and v(t) be Er-valued functions and H(t), an 
M-valued function over the closed interval [0,7] such that 
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(a) Hft)z(t) and v(t) are continuous, 
(b) [E< H. 


If 
(4.1) da (t)/dt = H (t)e(t), 0StSr, 
holds, then 
l Lel SS e e0). 
Instead, if 
(4.2) de(t) /dt = H (t)e(t) + v(t), 0StSr, 


holds wiih z(0) =0, then 
Lepa foren | o(s) ] ds. 


Proof. Replace H(t) by B(t), which is integrable over [0,7] and 
satisfies also the conditions (b) and (c). Then it is well known that, in the 
case of (4.1), 


z(t) = U(t,s)z(s), 8, bE [0,7], 
where U(t,s) is an M-valued function with || U (t, s)| <e*l*-l, Thus 
IE = | O(¢,0)2(0) | Se" | (0) ]. 
In the case of (4.2), 
t 
z{t) = Í. U (t,s)v(s)ds. 


Hence 
BOES ASIOI 


5. Vector fields with stable manifolds. Let X be a vector field. We 
shall denote by exp Xp the integral path of X that passes through the point 
p when t=0. Then expX becomes a diffeomorphism. 


Now we let X be a C® vector field about the elementary critical point 0 
with an unstable manifold V+ and a stable manifold V-. Let VE, 
Ta, T- 2, x be in the form as given in §2. Denote by X, be the linear part 
of X. Let Xo, and X, be the respective restrictions of X, on V+ and V-. 
If =a (2*)?, then, for ¢ sufficiently large, say t= 1, 

E3 
B (exp tXop) = 2B (p) 


for any pE V*. We set 
i 
Q.(p)— f BexpsXo.p) d 
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which is obviously a positive definite quadratic form on V*. Moreover 
XoQs = [4(9, 0 exp tXo,) /dt] t-0 
= [d/dt f "B o exp $X 9,48] to 
— Boexp Xs, BEB; 


Consequently X,,Q, is also a positive definite quadratic form on V*. Similarly 
we construct a positive definite quadratic form Q_ on V- such that X,_Q. is 
negative definite on V-. 

Now we define the positive definite quadratic form 


Q(z) = Q.(2*) + Q-a) 
on E” and the norms precisely in the same way as in 82. Let Y be another 
C* vector field about the critical point 0 such that the linear part of Y is 
also Xo Both X, || x |? and — X, | z ||? are positive definite on V+ and V- 
respectively. We may find constants 89° > œ > 0 such that 
(5.1) Ra a? < Xo al? < 26" | ol, 
(5.2) 9° 2g x8 <— Zo |z < 2p fel. 
Therefore, for p > 0 sufficiently small, there exist constants a, 8 with a> a’ 
and £’ > 8 > 0 such that, in Spt, l 
(5.3) 28 laS E rl S Ra le l, 
and the same holds for Y. 


Lemma 5.1. There exist positive constants po > 0, a> 0, B>0 such 
that, in Sp 


(5.4) elel,<Xlel,splel, 
(5.5) alzl.<rlel.<plel, 
(5.6) ale|-<—X|el-<plel. 


Proof. The inequalities (5.4) and (5.5) follow from (5.3). The vector 
field Z = X — X, is also tangent to V* so that 


Zz |-*=o0(| z ]-*) 
uniformly in Sp,* for po sufficiently small. Hence (5.6) follows. 


Now we choose po > 0 with the additional property that X and Y are 
of C° over the closure of Sp, 
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Consider the path exp-tXp. As long as it stays in Sp,*, the preceding 
lemma implies that || x(exp-tXp)], is decreasing and that | 2(exp-tXp) |- 
is increasing. 

Set pı == po/2. Let p€ Spt. Then 


| e(exp-tXp) |- 5 | z(exptXp) |. < p 
and, consequently, 


| 2(exp-tXp)] < pı = pos 
i.e. exp-tXp E€ Sp,* until the path meets Sp,°. For each pE Spt, let 
t(p) = inf{t: | c(exp-tXp) |], = | z(exp-tXp) |-, t = 0}. 


Similarly, we define ¢(p) S0 for pe 8,”, p sufficiently small. We may say 
that t(p) is the time for the path exp-tXp to reach the cone || j, = | £ |. 
Since exp-tXp is a C” function of p and t, it follows from the implicit func- 
tion theorem that t(p) is a C° function of p. We may take po TENEI 
small such that t(p) is of (= in 8p,—V+t—V-. 

For pE V* (or V-), we define t(p) =œ (or —œ). We leave t(p) 
undefined at 0. 

Observe that, for pe Sp,* and OStSt(p), we have 


(5.7) ebt | o(p) |S | (exp-+Xp) |. So | e(p) | 
and therefore l 
(5.8) | z(exp-tZp) | S V 2e% | o(p) h £20% | 2(p) |. 


As a matter of fact, (5.7) and (5.8) hold for any p and ¢ as long as the 
path exp-sXp, OSs S t, lies entirely in Sps. 

For any y>0, define t(p,y)=t(p) or yt(p)/|t(p)| according as 
|4(p)| Sy or |t(p)| > y. The function t(p, y) is continuous over Sp, — V*— V- 
and is of C” over the same region except at those points p with |t(p)| =y- 


6. Main lemma for vector fields. For any function f and any mapping 
c, we write as usual 


otf—foo 


when the composition at the right hand side is properly defined. Ifo is a 
local diffeomorphism and if X is a vector field, we define 


Adj oX == o*1Xo*, 


Geometrically, the diffeomorphism o carries the vector field X to the vector 
field AdjoX. For detail, see [4]. 
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The purpose of this section is to establish the next result: 


Luma 6.1. Let X — Nat(z)d/ört be a vector field defined about 0 
and having 0 as an elementary critical point. Let R» be the direct sum of 
two linear subspaces V+ and V- which are the respective stable and unstable 
manifolds of X about 0. Then, for any vector field Y = > bt (z) 8/dx* having 
contact of infinite order with X at 0, there exists a local diffeomorphism o 
about 0 such that 
AdjoX =Y 
in a neighborhood of 0. 


Let X be in the form as given in the preceding section. We are going 
to construct a diffeomorphism o such that it leaves the cone | zl =} z |l- 
pointwise fixed and carries X to Y. Since any flow of X about 0 either lies 
in Y*U V- or passes through the cone, the image under ø for any point. about 
0 not lying in V, U V~ is well determined. However it is a complicated matter 
to show that o is actually of O” about 0. The geometric notion of such a 
diffeomorphism o was used by Birkhoff and Bamforth [1] in the case n==3. 

Let M and A, be positive numbers such that, in ate 


| (a(2)) 1 <M, 

Ira) 1 <H, 

lo(z)[S4-fel, 1,2, 
where v(x) = (v#(z)) = (bt (z) —a*(z)). Define, for y= 0, 

oyp — (exp t(p, y) Y) (exp—t(p,y)X)p, 
when p is not the origin, and 
3 oy0 anes 0. 

Luma 6.2. There exists pa O < pz < pi, such that 


(a) for any pe Sp, and y>0, the path nee t 
running from 0 to t(p,y), lies entirely in Sp, 


(b) there exist K,>0, r=1,2,° - -, with 
| e(o.p) —2(p)| SK, || 2(p) |r 
for pe Sp, and y= 0. 


Proof. Set 
€(t) =a (exp tY q) — z (exp tXq). 
If both paths exptYg and exptXg, OS tSr, lie in Spy then 
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(6.1) dé/dt = [b (£+ z (exp tXq) ) —b (v (exp iXg))] + v(z(exptXg)), 
with (0) =0. The theorem of the mean yields 
bt (f+ æ (exp tXq) ) — bt (z (exp tXq)) = X bit (mE, 
when y, belongs to the convex neighborhood Sp, Now (6.1) takes the form 
of (4.2), and it follows that 
t 
LEHIS fr» | o(2(cxpexg)) I ds 


S f| DA, | o(oxp Xa) |7 ds, 
0 


Let pe Sp,* andg—exp—t(p,y)Xp. For simplicity, write y’ == t (p, y). 
Then the path exp ¢Xq = exp — (y —t)Xp, 0<St=<y, lies in Sp,*. As long 
as exp tYq, 0<t=y also stays in Sp,*, we shall have from (5.8), 


(6.2) EDISA, f esen | 2(oxp— CY 2) Xp) d 


| 
<A, f eMi-o) (26-0) | o(p) ||)" ds 

0 
LYA (—M rajte- | 2(p) |r, 


provided r œ> M/a. Set 
K, = 2°A,(— M + ra) 


for r > M/a. Choose pa, O < ps < p1/2, such that for some r > M/a, 


Kra(pa)” pı < 8Bpo/4. 
Then, for any p€ Sp,*, the path exp—tXp, 0<t<t(p), lies in Spt. 
Consequently, the path expiXg, Oty’, stays in S,*. .We assert that 
the path expt¥g, 0<:<y, stays in Ispa In fact, if this is not true, then 
there exists y”, that is the least positive number such that 

| =(exp y" Yg) | — 8po/4. . 
It follows from (6.2) that 

| (exp y Yg) Sle”) + lele y” Xg) 
S Krpa + pi < 8p0/4, 


which is absurd. The part (a) of the proposition is now established. For 
r > M/a, we have 
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| z(o,p) —2(p) || = | z (exp y Yg) —z (exp y Xg) | 
SK, lepp. 

Since (b) holds for r sufficiently large, it holds for all r == 0,1,2,--.. Hence 
the lemma is proved. 

Proof of Lemma 6.1. Write T == exp X and U=expY. Then T has 
V+ and V- as its respective stable and unstable manifolds. According to 
Proposition 7.1, T and U have contact of infinite order at 0. If k(p) is 
defined as in §2, then k(p) is the greatest integer St(p). Lemma 6.2 
assures that o, has contact of infinite order with the identity mapping at 0. 
It is then evident that, with the local homeomorphism e, thus defined, Lemma 
3.1 may be applied. Moreover, each local homeomorphism or, k > 1, given 
in the lemma coincides with that defined in this section. It remains to verify 
that Y —AdjoX or, equivalently, 


(6.3) exp t¥op =o oxp tXp 
for p about 0 and |t| small. Note that, for p about 0 and pe VtUY-, 


op = (exp t(p) Y) (exp—t(p)X)p, 
and (6.3) holds. 


For p about 0 and pe V+ (or V-), we have 
op = lim U*T*p, 
kaw 
For ¢ near zero, 


| z(exp t¥oxp) — z (ox exp tXp) | 
= | z (U*o exp — (h—t) Xp) —z(U* exp— (k—t)Xp) |, 


by repeated application of the theorem of mean, 


SSM | (Uo: exp — (k—t) Xp) —2(U* exp — (k—t) Xp) | 
=: SM*|o(o,exp — (k —t) Xp) — z(esp— (k—t) Xp) |, 





by Lemma 6.2, 
= MEK, | (exp — (k—t)Xp)|r 
S MEK, (de || z(p) ||)" 


‘which tends to zero as k>« provided a suitably large r is used. Hence the 
lemma is proved. 
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7. Formalization. Again, we are going to work in the n-dimensional 
space R” with a given system of coordinate (z*), whose origin is 0. 

Denote by F the totality of (the germs of) functions of C” in a neighbor- 
hood of 0, by A the totality (of the germs) of vector fields of C” about 0 and 
vanishing at 0; and by G the totality of (the germs of) the local homeomor- 
phisms of C” in. a neighborhood of 0 and leaving 0 fixed. Then F is an 
algebra over the field R of the real numbers, A is a Lie algebra over R, and 
G is a group. 

Denote by % the algebra of the formal power series in z= (z*) of the 
form 2 ont m€ R; by U the Lie algebra of the formal vector fields of 

m 


the form 
> at (x) 9/éa*, 
del 


where each ä(z) € % has a vanishing constant term; and by © the group of 
the formal transformations (h’(z),- - -,h"(x)), hte %, such that R*(0) == 0 
and the Jacobian det(@f*/dzJ) has a nonvanishing constant term. 
For fE Y, ZEN, c€ ©, the meaning of Ê? and that of 5%? are clear. 
We define Sos 
Adj êf = 369/824, 
where 
be (64) *¥5*z6, 


Define @¢: F—>% such that, for fE F, @rf is the Taylor’s expansion of 
f about 0. Define ®,: A—> A such that, if X = $ at(r)d/dz*, then 
04X = I (Gea!) 0/02, 
and define ®@¢: G— © such that, for o€ G, 
Oco = (Or o*a,- - +, Opo*s"). 


We shall not distinguish ©r, ®,, ©. and shall denote all of them simply by ©. 

It is known that there always exists a function f€ F having a given 
Taylor’s expansion about 0, i.e. @r is onto. So are ®, and ®.. It is 
straightforward to verify thet ©r, ®4, @¢ are respectively algebra, Lie algebra 
and group homomorphisms. Moreover 


© (Xf) = (@X) (ef), 


©(o*f) = (®c)* (0f), 
@(AdjoX) = Adj(@c) (0X). 
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For X€ A, (exptX)0=0 for any value of t It follows that exp iX 
always exists and belongs to G. 

PROPOSITION 7.1. If OX —@Y, X,Y € A, then, for any value of tE R, 

@ exp tX = ® exp tY. 

Proof. Write X = > a*(x)@/éc+ and Y = X 6*(z)6/dz*. Set o; = exp tX 

and n—exptY. We are going to show that, for any value of t, 
(2+0 0i)m(0) = (zto7)m(0)- 


For |m |= 0, this is evidently true. Now, by induction on |m |, we have, 
for r=|m|>0, 


Al (2t © 0)m(0) ]/dt = [dr (ö2* o 01/88) /da™| s0 
== [öra (2004) /02™] a0 


Fr) dm HP, debs sn 


where P+ may be expressed as a polynomial in aw(0), |m’|=|m |, and 
(a^ 004)m(0), A= 1, + +4, |m |< |m|. Then, by induction hypothesis, 
(zt o7)m(0), il, ',n, satisfy the same systems of linear differential 
equations with the same initial conditions at t= 0. Hence the proposition 
is proved. 


Definition 7.1. For Xe AU, define 
exp X = @ exp X, 


where X is any element of A with OX = X. 

Tf f(t) is an $-valued function of a real variable t, df(t) /0é is under- 
stood to be obtained through term by term differentiation with respect to t. 
Lt Xu) = Dâ (t)0/dct is an W-valued function of t, we define 


8X (t) /Ot = > (04+ (t) /0t) 0/8c+. 
It f(z, t) is of O” in æ and ¢ for (m,t) in a neighborhood of (0, to), 
then 
© (Of (2, t) /at) — 60f (a, t) /at 
in a neighborhood of tə» An analogous assertion also holds for BAR 
Proposition 7.2. If ¥,¥ewu and if o:==exp tÊ, then 
8 Adj 6. Y/Ht = [Adj ôf, X]. 
Proof. Choose Z,F€A such that @®X—X and @Y =F. Write 
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og=exptX. It is known (see, for example, Theorem 2.2, [4]) that in a 
neighborhood of 0, 
8 Adj o:¥2*/ot = [Adjo:¥, X]z'. 
Thus 
© (8 Adj o,¥'xt/at) = @[ Adj oY, X]2t — [Adj & Ê, X] et. 


The left hand side is equal to 
a (© Adjo,Yz*) /öt == 0 Adj &Y¥at/at. 


Hence the proposition holds. 

Denote by % the totality of homogeneous polynomials of degree r in z. 
Then the algebra % has a graded structure, which is called a formal algebra 
in [8]. We define A) to be the totality of X € X such that £ = > ât (x) 0/éx* 
with each ât (s) € §*), Then Y has a graded structure with 


(x, MO] c gee), 

Let 

mr: A> AM, r=0,1,-°°, 
be the projection. Now fm Adj &:¥ is the solution of the formal differential 
equation 

dL /dt m [2,X] 
in the formal module X with the initial condition Z(0)—=Y. If mX =0, 
then 
Z(t) — Ê +t, Ê] + PLÈ, X, X]/214- > - 
— (exp tad Ê) Ê, 
where ad X denotes the linear transformation ¥ > [Î, X]. (See p. 115, [3].) 
We summarize the above discussion in the following statement: 


Proposrrion 7.3. If 2, Êe U and mk =0, then 
(Adj exp £) Ê = (expadX)Y. 


Definition 7.2. We say that X, Y € A are equivalent if there exists « € G 
such that Y — Adj cX. l 

Similarly, we say that X, Fe W are equivalent if there exists ¢€ & such 
that ¥ — AdjéX. 


8. Formal Lie algebra. Let Q == Q0 +2 +--+ be a formal module 
over a field X with the projections m: R22”, r=-0,1,---. I£ Q is 
furthermore a Lie algebra over K such that for any X,Y €Q, 
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ml, Y] =2 Lng, maY], 
=0 
then 2 is called a formal Lie algebra over K. 
For X € Q, let ad-X be the endomorphism of 2 such that 
(ad X)Y = [Y, X]. 


Definition 8.1. We shall say that X,YEX are (formally) conjugate, 
if there exists Z € Q with m,Z = 0 such that 


Y = (expadZ)X. 
Obviously I is a formal Lie algebra over R. If £, Ê €N are conjugate, 


then, according to Proposition 7.3, they are equivalent. 
For any X € 2, denote by 


ad, X: Wr) > WH) 


the restriction of ad X on 2”. The kernel and the image of ad, X will have 
the usual notations kerad, X and imad, X respectively. 


Proposition 8.1. If, for X€&, there exist subspaces HN CW such 
that QO) is the sum (not necessarily direct) of @© and imad, rX, then X 
is conjugate to some FEN such that 


(a) mY asx 
(b) mY ES, r>0. 


Proof. We are going to construct Z such that 
Y = (expadZ)X 
satisfies the requirements. First, we set moZ == 0, Choose 7,4 such that 


mY = mX + [rX mZ] = rX — (adro X )mZ € $0. 
In general, 
ary mX + [ro X, 7] 
+ (ade i2) (mX) 
+1/2! Z (ad) (edm) (mL) + 


+k=r 


= ră — (ad, roX )arZ + E 


where R, is determined by m&X1,° © +,a1X%, m2, ©, ur. Itis then clear 
that there exists z,Z such that YES”. Hence the proposition is proved. 
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THEOREM 8.1. If, for XER, noX =89 4N satisfies the conditions: 


(a) SER, NERO, 

(b) [S, N] ne 0, 

(c) ad,S ts semi-simple and ad, N is nilpotent, r-—=1,2,---, 
then X is conjugate to some S-+ N’ such that m N’=N and [8, N’] =0. 

Proof. Since ad, S and ad,N commute, ad, N leaves both ker ad, 9 and 
imad,S invariant, and so does ad-(9-+N). Moreover, ad-9 is an auto- 
morphism on im ad, 5. 

If ze imad, 9, 2540, and ad, (S+N)r— 0, then 


ad, Nz == — ad, Sz. 
Let s be the least positive integer such that (ad, N)®r—=0. Then 
(ad, N)®z —=— (ad, 8) (ad, V)**z 0, 


which is absurd. Therefore, ad,(S-+N) is an automorphism on imad, 3 
so that 
(8.1) imad, 9 C imad, (9 +N). 


We may choose HN) == ker ad, 8, where §” is as given in Proposition 8.1. 
Set N —=7—S$. Thus the theorem is proved. 


9. Rational n-tuples. Denote by Ro” the vector space of the n-tuples 
of rational numbers. Any element of R,” can be written as 


e= (m, (6), > "My (@) ). 


If J is a subset of {1,- > -,n}, the totality of e with m;(e) =0, j E€ J, will be 
called a face of Rọ”. It will be said to be proper when J is not empty. For 
any subspace U of Ro”, denote by 11* the subset of U consisting of all e with 

m,(6) Z0, i=l, ',n. 5 


Proposrrion 9.1. For any subspace U of Ro”, there exist un," + -, un € Ut 
such that every element of U* can be expressed as 
(9.1) l sent + + at 
where the a’s are non-negative rational numbers. 
Proof. Let Ba’ - -,% be the faces such that each ®, contains at least 
one nonzero element, say, wEll*. We are going to show by induction on n 


that the proposition holds for the ws so chosen. The case n= 0 and that of 
A=0 are trivial, Assume n>0 and A>0O. Let e be any element of U. 
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Let a be the least non-negative number such that e— au, belongs to the inter- 
section of Ut and a proper face. The induction hypothesis now applies. Hence 
the proposition holds for e. 

Denote by U(%) the totality of the elements u of U with m,(u) = 0 for 
t4k and m(u) =— 1. 


PROPOSITION 9.2. Gwen k, 1Sksin, there exist v, °, E U(k) 
such that any dE U(k) can be expressed as 


(9.2) d= Bi ++ + Buta +e 


where e€ Ut with mx(e) —0 and the f’s are non-negative rational numbers 
whose sum is equal to 1. 


Proof. The case n= 0 is trivial. We proceed by induction on n. If 
U(k) consists of one element only, then the proposition is obvious. If UW 
contains a nonzero element e with m,(e) =0, then, for any element d of 
U(k), there is a non-negative rational number £ such that d— ße lies in the 
intersection of U(x) and a proper face, provided n>1. Then the induction 
hypothesis may take over. The separated case of n==1 is also clear. 

Now assume that U+ possesses no nonzero element u with m,(u) —0. 
Let d’ be an element of 11(k), which is distinct from d. For some t, j, we have 


m(d) < m(d’) 
and 
m;(d) > m,(d’), 


for otherwise one of d—d’ and d’-——d has to belong to U+. Set 
d(t) == (1—t)d-+ td’. 


Then, for some 40 and ¢,=1, both d(f,) and d(t,) belong to U(k) as 
well as a proper face. Since the proposition holds for d(t,) and d(t,), it 
also holds for d and d’. Hence the proposition is proved. 


10. Construction of a decomposed vector field. Our aim in this section 
is to construct a vector field as specified in the next theorem: 


THuorem 10.1. Let S= > s;'2/0/dct and NEW be such that 
4,3 
LY, 88] = 0. 


If then Xn matrix (s;') is semisimple, t.¢., similar to a complex diagonal 
matris diagonal (A1,° + ",An), then there exists N in A such that eN=N 
and 
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[N, 8] =0 


First, we extend the formal Lie algebra X to the formal Lie algebra of by 
extending the ground field R to that of the complex numbers. By a linear 
- change of the coordinate system, we may obtain a system of coordinates (z*), 
t—=1,--°+,n, such that 
(10.1) 8 = > duz'8/02+. 


Since 9 is real, we may further demand that the coordinates z*,- - -,2" occur 
in conjugate pairs. 

Let ® be the centralizer of @$ in the Lie algebra X i.e. the totality of 
Xe with [¥,@S]—0. It is easy to see that B is also a formal Lie, 
algebra. 

Denote by U the subspace of Ro” that consists of all u with my (u)u—=0. 
We say that well is integral if all m,(w) are integral. Denote by U<ky 
the totality of u€ U which are integral with m,(u) 2 —1 and m(u) Z0, 
tk. In short U<k> is the totality of the integral elements in U(k) U Ut. 

PROPOSITION 10.1. The totality of zmi®zkd/dzk, de U<ky, | m(d)|—=r, 
k=1,: : -,n, is a base of BO, r—0,1,---. 

Proof. The proposition follows immediately from the fact that 

[arzt /ö2%, 9] = — I muz” 0/02. 

Let ua: °- un E Ut be given as in Proposition 9.1. For a given k, 
let v4, ° *,%,€ W(k) be given as in Proposition 9.2. 

Any d€ U<k> can be given in the form 


(10.2) d= atha +: + aun + Bids ++ + Buty 
for some nonnegative rational numbers œs and ß’s, where either 
Bite HBa =l or Bam ß—0. 


Let 


y*/4—= max{| m(uz)|,- > -, | m(uy)|} 
and 


S==max{|m(v;)|,- © +, | m(v,) |}. 
Write any del < k> in the form of (10.2). Then l 
[mD] — a | m(us)] E> + m ma(an)| + Ba md] +: + Ba Llon), 
and, for | m(d)| > 28, 


12 
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Eat Du | mu) | Z| m(d)|—8 > | m(a)|/2 
so that 
(10.3) D% > 2y| m(d)|. 


Each of u`- -un may be replaced by a positive integral multiple of 
itself. Therefore, we may assume that u,‘ ' ‚u, are all integral. Set 
gy == aus) and 

b= didi +: tan 


which is real valued and is defined over R”. 
Let x(t) be a real valued C” function on the real line such that x(t) =1 
for |¢|S1/2, x(t) =0 for |t|21, and OX x(t) S1 for 1/2 < |t] <1. 


Proof of Theorem 10.1. We shall assume that à > 0 so that ® exists. 
Otherwise each U<k> consists of a finite number of elements so that 
H — {0}, and thus m N—0 for r sufficiently large. The construction 
becomes trivial by simply setting 


Ne SaN. 
r=0 
Now write 
(10. 4) ar = X, b (2) 248/82+. 


Since N € BO, we have 
bt (2) =E bt (d) am 


summing over all de Ui) with | m(d)| =r, where each b*(d) is a complex 
number. Write c, == $; | b*(d)| summing over i—1,-- -,n and all de U<i> 
with |m(d)|=r. Set 


h (2) = She (2) a*x(rle,®). 


When & > 0, the right hand side is a finite sum, and A¥(z) is of C” over the 
region: ®>0. We are going to show that h*(z) is of C” at any point p 
with (p) ==0. For this purpose, it suffices to prove that, given any positive 
integer s, there exists a positive integer r, such that 


(10. 5) het (2) = > by (2) ax (110,8) 
—0(|z—-2(p)|*), 
where |x| = (X | zt |?)3. 


Take a neighborhood N of p such that, in Jt, || <1 and |grad®| has 
an upper bound L. Then 
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|8 |=|8—2(p)| SL |z—e(p)|. 


Choose r, such that (a) 2yro >n and (b) yro >s +2. 

It follows from (10.3) that if, for de U<ky, | m(d)| Z= ro, d is expressed 
in the form of (10.2), then we have X, æ; >n, which implies that 4 > 1 for 
some f. Since ;(p) ==") (p) == 0, there exists j with zi (p) ==0 and 


m,(1%4) Z1. Consequently 


my(d) > amy(w) > 1. 


which means that z”(z* has 2/ as a factor. Therefore we conclude that, for 
dE Uck> and | m(d)| > r., the function 2*@ vanishes at p. 

On the other hand, owing to | m(Xfi%)| < 8, we may choose the neigh- 
borhood N such that | z*@4:)z* | has an upper bound K in N for any choice 


of dE Uck>. Then, for | m(d)| Zr, we have in 9N 


| mC gh | = | pa +» pam Bev) gh | 
SKE? <= Korn], 


Tf r= ro and rie <1, then 
| b*(2)2*x (ric) | S KEY S Kpr! 
= Kört/r!s KL | s—a(p) ]***/r! 
When ric,’ > 1, then 
| BF (2) 2x (riod) | = 0. 
With this remark, we have shown (10.5). 


We now define 
N = $ ht (2) 0/028. 


Since mÑ — $ b, (2)210/02t is real, for any fE F, 
Nf =F (mNf)x(r!c®) 
r=0 


is real valued, i.e. Ne A. Evidently oN —JN. 


Now 
Sx(rie,b) = rex (ric,6) Sb — 0. 


When & > 0, 
N=Dx(rte-b)a,N, 
the sum being finite, and 


[N, 8] = E.x(r1e®) [r N, 8] = 0. 
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The dimension of the algebraic manifold ® ==0 in R” is less than n. There- 
fore [N,8] vanishes throughout E” by continuity. Thus the proof is 
completed. 


11. Proofs of main theorems. We are now ready to prove the main 
results stated in the introductory part of this paper. 


Proof of Theorem of Decomposition. It suffices to show that X is 
equivalent to S+N. Write X—@X and mX—S-+ WN’, where 8 is semi- 
simple and N’ is nilpotent. Observe that ad, 8 is semisimple when it operates 
on X) and therefore on X”. We assert that, in the same sense, ad, N” is 
nilpotent. 

In fact, for a given r, there exists a positive integer } such that 


NRO) BEE = Nix) = {0}. 

For any Z € AO, we then have 

( (ad, Ñ) EÂ) 2t (NZ — On NP HÊN 4+ 4 Ona bN) 24 = 0. 

Therefore, by Theorem 8.1, X is conjugate, in A, to 8 + Ñ with rN = Ñ’ 
and [N,8]=0. It follows that X is equivalent to some X’€ A such that 
@X’ m= §-+-N. For simplicity we assume that X is already in the form of X”. 

Let 3, (X-) be the subset of {1,-+-,} that consists of all + with Rex, > 0 
(Rey <0). Denote by V+ (V-) the subspace of R” such that zt? — 0, tE- 
(iE). If de Uck> and FES, (kES_), then m,(d) > 0, for some jE% 
(je S-), otherwise 


Sm,(d) Rey  m,(d) Reay + I m (d) Red 

JEM JEM 
would not vanish. Therefore, if b,*(z) is as given in (10.4), then b,*(2)2* 
vanishes on V-. Let S and N be constructed as in Theorem 10.1. Then 


N and thus S + N leave V+ and V- invariant. By Lemma 6.1, X is equivalent 
to S+N. Hence the theorem is proved. 


Proof of Theorem of Equivalence. According to the preceding theorem, 
. X is equivalent to X’ == §-+ N, which leaves V* and V- invariant. 


Now @X’ and OY are equivalent in M, i.e. there exists € G such that 
Adj c@Y = 0X”. 


Take o € G such that Oc =ô. Write ¥’—Adjo¥. Then @¥’— 0X’. Apply 
again Lemma 6.1. We conclude that X and Y are equivalent. 


COROLLARY 1. If X is any vector field of C° about 0 and having 0 as 
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a oritical point, then there exists a C* stable manifold and a C° unstable 
manifold about 0, and the sum of the dimension of the two manifolds is n. 


COROLLARY 2, Let X == $ at (x)0/ðr* be of C” about 0 and possess an 
elementary critical point at 0. If the zeroes of the characteristic polynomial 
of the matrix (aj*(0)), Ay,’ + ",An, Satisfy the inequalities 
(11.1) mA dy, j=l: N, 
for any natural integers m,‘ ` `, Ma, with | m| = 2, then X is equivalent to 


tts linear part X, == X at (0) 240/drs. 


Proof. Let 8 and N be given as in the proof of Theorem of Decomposi- 
tion. It follows from Proposition 10.1 that (11.1) implies $0 —0 for 
r>0. This forces N =Ñ’, and @X is now equivalent to @X, in X. Hence 
X is equivalent to X, in A. 
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ON THE REAL TRACES OF ANALYTIC VARIETIES.*! 


By Wxi-Liana CHow. 


To B. L. van der Waerden on his 60th birthday 


1. Let V be a complex-analytic variety of complex dimension n which 
is the complexification of its real trace V°, so that V° is a real-analytic variety 
of real dimension n, and let X be a complex-analytic subvariety of complex 
dimension r in V such that X° =X N V° has the real dimension r (and 
hence £ — X). If we denote by ¢(X) and #(7°) the homology classes mod 2 
determined by X and V° respectively as topological cycles mod? in V, then 
their intersection class ¢(X)-$(V°), with due regard for their supports, can 
be considered as an element in Ho,»(V°,Z,). On the other hand, X° is also 
a topological cycle mod2 in V° and hence determines an element ¥(X°) in 
H,(V°, Zz). It is natural to ask about the relation between these two elements 
$(X)-$(V°) and y(X°) in H,(V°, Zz), since roughly speaking they represent 
respectively the algebraic intersection and the geometric intersection of X 
and V°. We shall give here an answer to this question for the case where V 
and X are algebraic. Our result is surprisingly simple: We have the relation 


(1) (X) EI) =y (T°)? 


in the sense of numerical equivalence mod 2 for algebraic classes in H,(V°, Z3). 
In case V° has the property that every homology class mod 2 is representable 
by an algebraic cycle, as for example in the case of a real Grassmanniän, then 
the relation (1) holds in the sense of homology mod 2. 

We can probably best illustrate our result by an interesting application, 
which was in fact the original motivation of our present inquiry. Let V and 
V° be respectively the complex and real Grassmannians of all s-spaces in the 
complex and real spaces of dimension m; if we consider V and V° as the 
respective classifying spaces of the complex and real s-vector bundles, then 
the universal dual Chern classes ¢,,- * -,¢s, and the universal dual Whitney 
classes Wi, °°, Wa are represented by certain Schubert varieties C,,---,Cs 
and their real traces (,°,- - -,C,° respectively. The precise sense in which 
the Whitney classes can be considered as the “real traces” of the Chern classes. 


* Received March 20, 1963. 
1 This work was partially supported by a research grant of the National Science 
Foundation. 
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has been made clear by Borel and Haefliger [1] by means of a mapping p 
of the complex-analytic cycles in V into H,(V°,Z,), so that one has the 
relation ¥(C;°) =p(C;). Now, if we choose the dimension m so that V° is 
orientable and hence the Poincaré duality (over Z) holds in V°, then the 
universal dual Pontrjagin classes p; are given by 0(C;)-6(V°), j==1,-- -,8, 
where 6(C;) and 9(V°) denote the homology classes over Z determined by 0; 
and V° respectively as cycles over Z in V, and the intersection classes 
6(C,) :9(V°) are to be considered as elements in H,(V°,Z). Since: the 
elements $(C,):¢(V°) can be identified with the reduction mod2 of the ` 
elements §(C;)-6(V°), our result then yields the following well-known relations 
between the Pontrjagin classes and the Whitney classes (or rather their duals) : 


pmo? mod2. 


A topological proof of these relations using transgressive elements can be 
found in’ [2], Appendix IT. 


2. Our proof of (1) is based on a theorem (Theorem 1) which gives 
a relation between the intersection of a cycle X with its conjugate and its 
intersection with V°., Although in this paper we shall need this theorem only 
for the case of algebraic cycles in an algebraic variety, we shall prove it here 
for the general case, both on account of its own interest as well as for the 
sake of possible generalization of our result. 

We begin by making a few comments on the intersection theory for an 
analytic variety, either complex or real, and the relations between the two 
cases. It is possible to develop an intersection theory for complex-analytic 
cycles in a complex-analytic variety along lines roughly similar to the now 
classical intersection theory for algebraic cycles in an algebraic variety. Such 
an intersection theory, just as in the algebraic case, is essentially unique, and 
it is compatible with the topological homology theory in the sense that the 
mapping $ (or @) which assign to each complex-analytic cycle in V the 
homology class determined by it in H,(V,Z,) (or H,(V,Z)) is multiplicative, 
i.e, p(X)-¢(Y) —=o(X-Y) whenever X-Y is defined. Recently, Borel 
and Haefliger [1], on the basis of a homology theory with supports previously 
developed by Borel and Moore, were able to obtain by topological methods an 
intersection theory for complex-analytic cycles in a complex-analytic variety. 
Since in this theory the intersection multiplicities are defined by means of 
homology classes with supports, there is no question here of compatibility and 
the mapping ¢ is so to speak “built-in.” For our present purpose it is im- 
material which theory is used; the only property we need here is the criterion 
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for multiplicity by means of small deformations contained in the following 
lemma. 

Before stating our lemma, we add a few words in eae of a E 
used in it. Let N be a neighborhood of the origin in the complex n-space and 
let e= (&,: ` *,@,) be a point in N; then we denote by T, the translation 
in N defined by the mapping z—>z+ e. As a transformation in N, T, is of 
course only defined in N N TN and maps it onto N N TN ; however, given. 
any neighborhood N’ of the origin such that N’C N, we have the relation 

`N’ C TN for all sufficiently small e. If X is any cycle in N, then we shall 
denote by T,X the cycle in N N T,X which is the image under T, of the restric- 
tion XN TN of X in NOT_N. Thus TeX is strictly speaking not a cycle in 
N, but for any N’ such that N’ C N, the restriction of T,X in N’ is a cycle for 
all sufficiently small e. If N is a neighborhood of a point p in a complex- 
analytic variety V such that there exists a system of local coordinates in V 
at p which is valid in N, and if X is any cycle in N, then we can extend the 
above definitions of T, and T,X to this more general case by means of the 
local coordinate system; and finally, if X is any cycle in V, we shall for sim- 
plicity write T,X for T.(X MN). 


Lamma 1. Let Y be a complex-analytic variety of dimension n, and let 
X and Y be complex-analytic prime cycles of dimension r and n—r respec- 
tively in V which intersect properly at a point.p; let N be a neighborhood 
of p in V such that X and Y intersect only at p in N and such that there 
exists a system of local coordinates in Y at p which is valid in N. Then there 
ts a neighborhood N’ of p in N such that for almost all points e in a sufficiently 
small neighborhood of p, the number of intersections of T,X with Y in N’ 
ts exactly equal to 1(X-Y,p). 


Remark. The expression “almost all” means here “all except for a 
proper complex-analytic subset.” 


Proof. The property to be proved being local, we can without any loss 
of generality take V to be the coordinate neighborhood N, or equivalently 
take V = N to be a neighborhood of the origin p in the complex n-space with 
the coordinates z = (%,---,2,); furthermore, we can assume that both X 
and Y are locally irreducible at p, for otherwise we can treat each irreducible 
component separately, replacing N by a smaller neighborhood if necessary 
(so small that any two different local components of X or Y at p represent 
different subvarieties in N). Now, just as in the abstract algebraic intersection 
theory, we can introduce the product cycle X X F in the product variety 
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Y X V, and show that the number of intersection points of X and 7,Y in N’ 
is the same as the number of intersection points of X X Y with T,A in N’ XN’, 
where A is the diagonal of V X V and T, as applied to A is the local trans- 
lation induced in N X N by the application of the original T, to the second 
factor alone. It follows then that our lemma can be reduced to the special 
case where Y is the linear variety in N defined by the equations 2, =: > -= <2, 
=0. The condition that X and Y intersect properly at p implies that the 
defining ideal of X (in the power series ring of n variables z,,° ` *,2,) is 
regular with respect to the given coordinate system, with z,,° * -,%, a8 inde- 
pendent variables. We have therefore, after a suitable linear transformation 
of the coordinates 241,‘ ° ",2» if necessary, the well-known “parametric” 
representation of X by equations of the form P(zu)=0;, u—f/D, 
tor +2, - -,n, where P (Zm) is an irreducible “ distinguished polynomial” 
in Zmı With coefficients which are power series in 2,,°- -,2,, the function D 
is the discriminant of the polynomial P, and the functions fu,‘ ` `, fn are 
polynomials in 2,,, with coefficients which are power series in %,° °°, 2. 
This representation is valid in a sufficiently small polycylindrical neighborhood 
N’ = {z | |u| < d} of p, and is to be understood in the sense that the points 
in X MN’ consist precisely of all solutions of these equations in N’ for which 
the systems of values of 2,,-  ",% are not zeroes of D, as well as all limits 
of these solutions as the set of values of Z,’ ' ",2, approaches a zero of D 
in N’. (We observe that this implies in particular that X NN’ has no 
limiting points on the boundary of N’ outside of the subset satisfying the 
conditions 43—=d; for t==-1,:--,r.) Therefore, if ¢ is the degree of the 
polynomial P (2,41), for any set of values of 4,:- -,2, with |u| < d which 
is not a zero of D, the ¢ distinct zeroes P (zm) will give rise in this represen- 
tation to ¢ distinct points in X N W’, and these are the only points in XY N WN’ 
having the given set of values for the coordinates 2,,° --,2,. Now, let N” CN’ 
be a neighborhood of p such that for every point e in N” we have the relation 
N’CT,N (we can evidently assume that N’ C N), then for every e in N” 
the restriction of TY to N’ is the variety defined by the equations 
2 = l," ° *,2-—= 6, It follows that for any such point e for which the 
subsystem ¢,° °°, é is not a zero of D, the intersection points of X with 
T.Y in N’ are precisely the ¢ points obtained from the above representation 
of X by setting zı = &,' ` +, Z= en. Our lemma i(X-Y,p) = t follows then 
from [1], 4.10, by observing that 7,Y intersects X transversally in N’ and 
that the intersection of the set {2| |a| Se, i=1,: r} with XNN ia 
compact. l 
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- 8. In case of a real-analytic variety V° the situation is somewhat similar 
if one takes everything over Z, instead of Z. Here we have a mapping y 
which assigns to each real-analytic cycle in V° the homology class determined 
by it in H,(V°,Z.), the reason for taking Z, being the fact that the real- 
analytic varieties are not always orientable. However, there is a difficulty due 
to the fact that in the real-analytic case the sheaf of ideals of a subvariety 
is not necessarily coherent, in contrast to what is known in the complex- 
analytic case. This leads to the unfortunate situation, first pointed out by 
H. Cartan, that it is not always possible to resolve globally a real-analytic 
subvariety into irreducible components in a reasonable manner; and since 
the analytic cycles are defined in terms of irreducible subvarieties, this makes 
it difficult to give a meaningful definition of the analytic cycles. One could 
remedy this situation by restricting oneself to the “coherent” subvarieties, 
i.e. subvarieties whose sheaves of ideals are coherent, but this would have the 
drawback that even some real-algebraic subvarieties defined by single real- 
algebraic equations would be excluded. A satisfactory compromise seems to 
be the notion of a C-analytic subvariety, first introduced by H. Cartan [4], 
which roughly speaking is a real-analytic subvariety which has a global com- 
plexification. As has been shown by Whitney and Bruhat [5], the C-analytic 
subvarieties have many of the “good” properties of the complex-analytic sub- 
varieties; in particular, such a subvariety admits a unique decomposition into 
C-irreducible components, whereby a C-analytic subvariety is said to be 0- 
irreducible if it is not the union of two distinct C-analytic subvarieties. 

Although the way seems to be thus opened for an intersection theory for 
real-analytic cycles in a real-analytic variety, there does not seem to be at 
this moment such a theory which runs more or less parallel to the complex- 
analytic case and is independent of it. However, as Borel and Haefliger have 
observed [1], it is possible to derive an intersection theory over Z, for real- 
analytic cycles from the complex-analytic case by using the complexifications, 
with the result that the mapping y mentioned above is also multiplicative. 
To explain this briefly, let V be the complexification of V° (the existence of 
this complexification is assured if we assume that V° is paracompact) ; then 
a mapping « can be defined which assigns to every complex-analytie cycle X 
(over Z or Z,) of complex dimension r in V a real-analytic cycle X° over Z, 
of real dimension r in V°, and the intersection theory in F° is precisely sò 
defined as to make the mapping a multiplicative for the subset of all complex- 
analytic cycles in V which are invariant under conjugation (this set includes 
the complexifications of all real-analytic cycles in V°). This mapping « is 
defined for irreducible subvariety X by setting «(X) = X° =X N V’ in case 
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X° has the real dimension r, and setting a(X) —0 otherwise; this definition 
is then extended to complex-analytic cycles in V by linearity and reduction 
mod2. The composite mapping yoa of complex-analytic cycles in V into 
H,(V°,Z;) is then the mapping p mentioned in Section 1. For our present 
purpose it is significant to observe that a complex-analytic variety V can 
also be considered as a real-analytic variety, and the complex-analytic cycles 
in V, taken over Z;, are also real analytic cycles; and that the intersection 
theory for real-analytic cycles over Z, in V as a real-analytic variety, when 
restricted to the complex-analytic cycles in V over Za, coincides with the 
intersection theory for complex-analytic cycles in V as a complex-analytic 
variety, taken mod 2. 


THEOREM 1. Let V'be a complex-analytic variety of complex dimension 
n which is the complecification of a real-analytic variety V°, and let X be a 
complex-analytic cycle in V such that X and Z intersect properly in V at 
every component containing a real point; then X and V° intersect properly 
in V as real-analytic cycles over Zs, and we have the relation a(X-X) =X- V°. 


Proof. Since the properties asserted here are linear over Z,, it is sufficient 
to restrict ourselves to the case where X is a complex-analytic subvariety in V. 
Let n and r denote the complex dimensions of V and X respectively. Let p 
be a real point in X N X, and let z; = z; + iy; j=]1,: - -,n, be a system of 
local coordinates of V at p such that x, - -,v, form a system of local coordi- 
nates of V° at p. Let X be defined in the neighborhood of p by the equations 
fu(z) — gi (2) + thy(z) =0, k=1,: - -,s, where fp are convergent power 
series with complex coefficients and g, and hx are convergent power series with 
real coefficients; then X is defined by the equations fr(2) = gx(z) —thx(z) = 0. 
Then the analytic set X N Æ is determined in the neighborhood of p by the 
equations gx(z) —=hr(z) —0, and our assumption asserts that every com- 
ponent of the solutions of these equations has the complex dimension 2r—n. 
Now, let V* be a complexification of V considered as a real-analytic variety 
of real dimension 2n, and let 2,*,4;*,: ` -,2n*, y„* be a system of local coordi- 
nates of V* at p such that T1, Y1,` ' *,2n,¥, constitute its real part. If we 
set ge(2) = gu’ (2,9) +ige”(a,y) and fa (z) =h (2,4) + ihr” (2, Y), then 
the complexification X* of X in V* is determined locally at p by the equations 
ge (2%, y*) — he” (2, y*) — ge” (2*, y*) + he’ (2*,y*) = 0, k= 1,- - -,8; and 
it is clear that the complexification V™ of V° in V* is determined locally at p 
by the equations y,*==- + -,y,*—0. 

If we observe that g:(2,0) = k” (£z,0) —0 and hence also 92” (z*,0) 
== hr’ (z*,0) =0, then the analytic set X* N V°* is determined locally at p 
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by the equations gx (2*,0) = hy (z*,0)=0, be=1,---,s. On the other 
hand, since g,(z) and h,(z) have real coefficients, they remain unchanged if 
we first restrict the variables z to their real parts x and then replace these 
real variables 2 again by the complex variables z, i.e. gz(z) == gx’ (2,0) and 
hr(z) = hr (2,0). Replacing the variables z by z* it follows that every 
component of the solutions of the equations g,’(z*,0) == hy (z*,0) == 0, 
k—=1,‘ - -,s, in the neighborhood of p has the complex dimension 2r—n. 
This shows that X* and V°* intersect properly in V* at every component 
containing a real point, and by definition, this means that X and V° inter- 
sect properly in V. 

To prove the relation a(X-£)—=X-Y°, we shall show that both sides 
have the same multiplicity at each component. We need only consider those 
components of X N V° having a real dimension 2r—vn, for any component 
of a lower dimension will have complexifications ii V and in V* which are 
not proper components in X N X and X*+ N V°* respectively and hence will 
have by definition the multiplicity zero in both a(X,X) and X: V°. Let C° 
then be such a component, and let C and C°* be its complexifications in V 
and V* respectively, so that they are proper components in XM ZX and 
X* N V* respectively; let p be a point in C° which is simple in C (hence 
also in C°) and does not lie in any other component of XN V°. If Lisa 
local linear subvariety at p of complex dimension 2n-——2r, defined over R 
(i.e. by setting to zero 2r—n linear forms of the local coordinates z with 
real coefficients), which is transversal to C at p, then the intersection cycle 
L-X is defined locally in a neighborhood of p, and we have the relations 
i((L-X)-(£-X), p)n—i(X-¥,C) and #((L-X)-L%,p)n—=i(X- V°, 0°). 
Since our problem is essentially local (i.e. we only need to consider X as 
defined in a neighborhood of p), this shows that we can restrict ourselves to 
the case where 2r—n—=0 and hence O == C° == p. According to Lemma 1, the 
multiplicity (X-Z, p) of X-X at p is equal to the number of solutions in a 
suitable neighborhood N of the origin of the equations f(z + 2i6) = fr(2) — 0, 
k= 1,: - -,8, for almost all sufficiently small real n-vectors e. If we perform 
a local coordinate translation by replacing z by z + ie, then the equations will 
have the form f;,(z+ te) = fr(2—ie) =0, k=1,:  ',s, but the number 
of solutions in N will remain the same provided e is taken sufficiently 
small. If we set F(z) fs(2+ie) then our equations will have the form 
Fr(2) =Fr(z) = 0, k=1,: + ',8; hence, if we set Fy(2) = Gy (z) +iHı(z), 
where (7; and H, are power series with real coefficients, then our equations can 
be written in the form Gy(z) = Hy(z) 0, k—-1,---,8. On the other hand, 
again by Lemma 1, the multiplicity 1(X*-V*, p) is equal to the number of 
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solutions in N (replacing N by a smaller neighborhood if necessary) of the 
equations gx (z*, e) — hr” (z*, 6) = gr’ (2*,e) + hy’ (2*,e)=0, k—1,: 
for almost all sufficiently small real n-vectors e. If we set 


Gy (2) = Gx (2, y) +1’ (ay) and Hy(2) = Hy (2,9) +’ (2,9), 


then we have the relations Gy (æ, y) — Hr” (£, y) = 9x (a, y + ¢) — hr” (£, y + 8), 
and Gx” (x,y) + Hr (2, y) =g" (x,y +6) + he’ (z, y + e), since both sides are 
the real and imaginary parts respectively of the function F(z) = f(z + ie). 
It follows that G,’(z,0) = gx (z,e) — hr (z,e) and Hr(z,0) = gx” (a, 6) 
++ hy’ (z,e), and hence Gy’ (x*, 0) = gk (z*,e) —hr”(z*,e) and Hy (z*,0) 
= gx" (2*, 6) + hy’ (£*, 6), so that 1(X*-V™,p) is equal to the number of 
solutions in N of the equations Gy’ (x*,0) —H;,’(x*,0) =0, k=1,::>,8 
Now, since both G, and H, are real, a similar argument as before shows that 
G;,(z) = Gy (2,0) and H; (z) = Hy’ (z, 0), so that 1(X*- V*, p) is equal to the 
number of solutions in N of the equations G,(z) = Hz(z) =0, k=—1,:- -,8 
This shows that 1(X-X,p) ==-1(X*-V",p); taking both sides mod2, we 
conclude that #(X V°, p) is equal to the multiplicity of p in a(X-X). This 
concludes the proof of Theorem 1. 


Remark. The equation i(X-X,p) =i(X*, V*, p) shows that X and £ 
are transversal at p in V if and only if X* and V°* are transversal at p in V*, 
which is so if and only if X and V° are transversal at p in V. This can be 
easily verified by direct calculation of the equations of the tangent spaces of 
X, X, and V° at p. 


4. From now on we shall assume that V is algebraic and quasi-projective, 
and that the cycles involved are also algebraic. The reason for making this ` 
restriction is that the algebraic cycles in a quasi-projective algebraic variety 
can be “moved around” up to equivalence so that any two or finite number 
of them can be made to intersect properly (in fact even transversally, but we 
shall not need this). We shall state the properties we need here in a lemma 
as follows. à 


Lemma 2. Let V be a quasi-projective compler-algebraic variety, defined 
over R, which is a complexification of its real trace V°, and let X be a complex- 
algebraic cycle in V which is defined over R; then 


(a) there eatsts a complex-algebraic cycle X’, defined over R and 
rationally equivalent to X over R, such that X’ intersect properly in V any 
gwen cycle Y which ts defined over R (or over C), and 


(b) there exists a complex-algebratc cycle X”, rationally equivalent to 
X, such that X” and X” intersect properly in V. 
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Proof. We shall apply a result in [3]; for this purpose we introduce a 
universal domain K which contains € as an “admissible” field, and denote 
by Vx, Xx, Yx, the extensions of V, X, Y, respectively over K, so that Vx, 
Xx, Yx, are algebraic variety and cycles respectively in the sense of [3] and 
are defined over R, and V, X, Y are obtained from Vx, Xx, Yg, respectively 
by restriction to points which are rational over C. We now apply Lemma 2, 
Corollary 4, in [3] with R as the ground field, and obtain a cycle X (u) in FV, 
defined over a purely transcendental extension R(u)—=R(w,' ` +,tUm) of R 
and rationally equivalent to Xg over R(w), such that X (u) intersects Yx 
properly in Vx and specializes to Xx over the specialization u—>0 over R. 
Let fi(u) be a system of elements in R[w] which represent: the associated 
coordinates of the cycle X (u), and let p be a real m-vector which is not a 
common zero of f,(w); then there is a unique specialization X (p) of X (u) 
over the specialization u—> p over R, and X(w) is defined over R and is 
rationally equivalent to Xg over R. Now, the condition for two algebraic 
cycles in Vx to intersect improperly can be expressed by the vanishing of a 
finite number of polynomials in the associated coordinates of the cycles with 
coefficients in R. There exists therefore a set of polynomials g,(w) in R[u] 
such that X (a) intersects Yg properly in Vx if and only if p is not a common 
zero of g;(u). If we choose the real m-vector » so that it is not a common 
zero of the set f,(u)g;(u), and denote by X’ the restriction of X (u) to rational 
points over C, then X’ is a cycle in V satisfying (a). Next, let x be a 
complex m-vector which is not a common zero of fi(u); then there exist 
unique specializations X (a) and X (A) of X (u) over the specializations u — p 
and u— a respectively over R, and both X (u) and X(p) are defined over C 
and are rationally equivalent to Xg over C; and it is clear that X (a) is the 
conjugate of X (u). If we now take a system of variables v == (01,° ` -, Um) 
over R in K which are independent with respect to u over R, then the cycle 
X(v) has the same properties as X (u), except that the variables u are now 
replaced by v; furthermore, again by [3], Lemma 2, Corollary 4, the cycles 
X(u) and X(v) intersect properly in Vx. It follows then, just as before, 
that there exists a set of polynomials A;,(u,v) in R[u, v] such that X (a) and 
X(v) intersect properly in Vg if and only if the pair x, v is not a common 
zero of hy(u,v). If we choose the complex m-vector » so that the pair u, & 
is not a common zero of the set f,(w)Ax(u,v) (or equivalently of the set 
fi(u)fi(v)An(u,v)), and denote by X” the restriction of X() to rational 
points over C, then X” is a cycle in V satisfying (b). This concludes the 
proof of Lemma 2. 
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We are now in a position to prove the result announced at the beginning 
of this paper. 


THEoREM 2. Let V be a quasi-projective compler-algebraic variety, 
defined over R, which is a complezification of its real trace V°, and let X be 
a complez-algebraic cycle in V which is defined over R; then o(X)-$(V°) 
and p(X)?, both as elements in H,(V°,Z,), are numerically equivalent with 
respect to real-algebraic homology classes in H,(V°,Z;). 


Proof. By Lemma 2(a), there exists a complex-algebraic cycle X’ in V, 
defined over R and rationally equivalent to X over R, such that X and X’ 
intersect properly. It follows then from [1], Theorem 5.3, that 


p(X") = p(X) (ZN) — p(X). 


On the other hand, by Lemma 2(b), there exists a complex-algebraic cycle X” 
in V, rationally equivalent to X, such that X” and X” intersect properly in 
V. It follows then from Theorem 1 that X”-V°=4a(X”-X”) and hence 
#(X) (V°) =p (X”) -6(V°) =p(X”- X”). It remains only to show that 
p(X: X’) and p(X”-X”) are numerically equivalent with respect to real- 
algebraic homology classes in H,(V°,Z,). Let Y° be a real-algebraic cycle of 
the complementary real dimension to a(X-X’) in V° (i.e, if n and r are 
the real dimension of V° and a(X) respectively, then the real dimension of Y° 
should be n — (2r—n) —2n— 2r), and let F be its complexification in V; 
in view of Lemma 2(a), we can assume that Y intersect both X-X’ and 
X”’.X” properly in V. Since X-X’ and X”-X” are rationally equivalent, 
they must have the same intersection number with Y; it follows that a (X: X’) 
and a(X”-X”) must have the same intersection number with Y°=a(Y), 
and hence p(X- X’) and peed” ) must have the same intersection number 
with y(Y°). This proves our theorem. i 

We conclude this paper by mentioning one further application of our 
result. Assume that H,(V,Z;) has a numerical equivalence base B,,- - +, Bi 
> consisting of complex-algebraic cycles defined over R, and let M = (my) be 
its intersection matrix; then the cycle V° is numerically equivalent over Z, 


t . . 
to a cycle of the form € uBı. Now, Theorem 2 provides us with the numerical 
4 


h t 
relations & (9°) '$ (By) — e(B;)*, or 3 nymy = my, J= 1, > -,t, from which 
, 1 
we can easily calculate the n; and hence the self intersection number $(V°)? 


as a cycle over Z in V. For example, in case V is the complex Grassmannian, 
it is well-known that H,,(V,Z,) has a base consisting of the Schubert varieties 
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of complex dimension n/2 (none in case n is odd), each of which is the dual 
of some other or itself, and a simple calculation shows that the number ¢(V°)? 
is equal mod 2 to the total number of Schubert varieties of dimension n, or 
equivalently the number of those which are self-dual. 
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AUTOMORPHISMS OF COMPACT RIEMANN SURFACES.*: 


By JOSEPH LEWITTES. 


Introduction. An automorphism of a Riemann surface is a conformal 
homeomorphism of the surface onto itself. In this paper we investigate the 
properties of automorphisms of compact Riemann surfaces. For such surfaces 
with genus greater than one the group of automorphisms is a finite group. 
The result is due to Hurwitz [4] and is proved in the first section where we 
collect for reference most of the terms and theorems useful for our purposes. 
In fact the two important papers of Hurwitz [3], [4] have been the impetus 
for many of the topics that we consider. In the second section we discuss the 
representation of the group of automorphisms as linear transformations of 
the spaces of differentials and determine the dimension of the space of analytic 
differentials invariant under a group of automorphisms. In the third section 
we examine the diagonal form of the matrix of the representation in the case 
of a cyclic group of prime order. In the fourth section a new method enables 
one to obtain explicitly the matrix of the representation and leads to a striking 
result concerning the number of fixed points of an automorphism. Namely 
if a point which is not a Weierstrass point is fixed, then there are only two, 
`~ three or four fixed points. We then apply the general results to obtain specific 
information about the automorphisms of two particular types of surfaces, 
hyperelliptic and those having (g—1)g(g-+1) Weierstrass points, where g 
is the genus. A related result is that if S/H is the quotient space of a surface 
S under a group H of automorphisms of prime order N, then the genus of 
EA 
N 
Riemann-Hurwitz relation for it does not involve the number of fixed points. 


S/H is simply (#1, the greatest integer in >, which is independent of the 
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1. In this preliminary section we present the notation and a concise 
review of some of the theorems and concepts to be used later. As general 
references for the theory of Riemann surfaces one may consult [1], [8]. We 
concern ourselves with compact Riemann surfaces only. Let § be a Riemann 
surface of genus g; we denote by Dm the complex vector space of meromorphic 
differentials of type m on S, m = 0, and by Am C Dm the subspace consisting 
of analytic differentials. For example A, is the space of Abelian differentials of 
the first kind and D, is the space of meromorphic functions on S, which we 
simply call functions. It is known that A, has dimension g and any 0 E€ A,, not 
identically zero, has 2g — 2 zeros while for m > 1, dim Am = (3m — 1) (g —1) 
and any 0€ Am, not identically zero, has m(2g—2) zeros. 

If m: Sı—> S, is an analytic branched covering, S; having genus gı 
{t= 1,2), then the Riemann-Hurwitz relation states that 


where N is the number of ‘sheets’ in S, over 8, and B is the sum of the orders 
of the branch points on S. - 

(0) denotes the divisor of zeros and poles of 6€ Dm. Concerning divisors 
on 8 the Riemann-Roch theorem states r (bt) = d(b) +i(b) +1—g, where 
r(b"t) is the dimension of the space of functions which are multiples of b+, 
d(b) the degree of b, and i(b) the dimension of the subspace of D, consisting 
of multiples of b. As a consequence of this theorem one has the Weierstrass 
gap theorem which may be formulated as follows. To each point P € S, g > 0, 
there may be assigned a sequence of integers a(P) = (a, (P), > -,a,(P)) 
with 0 <a, Qi < G41, Qg = 2g, such that for each a, there exists a function on 
S with exactly æ poles at P and no others, and that if a function on S has poles 
only at P, these being n=2g in number, then n=, for some i. Such a 
function will be called a function at a,(P). The sequence complementary to 
a(P) in the sequence of integers from 1 to 2g is called the gap sequence; 
denoted by y(P) = (yı (P), ` +, y0(P)) where 0 < yo Yi < yuu Yo < 2g. 

P € 8 is called a Weierstrass point if «, (P) Sg. Hurwitx [4] has shown 
that if 9 has g= 2 then there do exist Weierstrass points, their number w 
is finite, bounded by 2g +2 <os (g—1)g(g+1). Denoting by W the 
set of Weierstrass points we see that P ¢ W if and only if y(P) = (1, 2,- - +, g). 
Also, one may prove that for any P€ 8 there exists a basis 0,“ © +, 0g of Aı 
such that 6, has a zero of order y,—1 at P. We call this a basis of A, at P. 

8 is called hyperelliptic if g = 2 and there is a function on $ with only 
two poles.- This is easily seen to be equivalent to saying that for some P € 8 
@,(P)=2. It can then be shown that 8 is hyperelliptic if and only if 
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a and that at each PEW, a(P) = (2,4, ,2g) and x) 
= (1,8,- + +,2g—1). 

An se of § is a conformal homeomorphism of J onto itself, 
Let H(8) denote the group of automorphisms of 8. If g—0 or 1 then it is 
clear that H (S) is not finite. On the other hand, if g = 2 Hurwitz [4] proved 
that H(S) is a finite group. We sketch the proof of this because it motivates 
some of the ideas which appear later. First, note that a(P), y(P) are 
invariants under H (9), for if f is a function at a(P) then fh is a function 
at o(h(P)); he H(S). In particular, h takes W into itself, giving us a 
representation of H (8) as a permutation group by means of the homomor- 
phism L: H(S8)—>%., % being the symmetric group on w letters, defined 
by L(h) =h | W. 2, being a finite group we need only show that the kernel 
of L is finite to conclude H(S) is finite. To this end we must examine the 
set of fixed points of kE H(S), points P—A(P). If hI, the identity, 
the set of fixed points of h being closed and W a finite set, we may find 
Pz£h(P), P€ W. Let f be a function at a,(P) so that it has g-+1 poles 
at P and no others. Then fı =f—fh has g+1 poles at P and g-+1 poles 
at h(P) AP and is otherwise finite; hence f, is not a constant, Clearly every 
fixed point of h is a zero of fı, which, having 2g +2 poles, has 2g 5 2 zeros. 
Thus A cannot have more than 2g +2 fixed points. 

Returning to the representation L: H(S) > Xa, if S is not hyperelliptic 
then » > 29-+2 and our above result on the number of fixed points not 
exceeding 29-+ 2 implies in fact that L is a faithful representation or that L 
is an isomorphism (into). If 9 is hyperelliptic, then it is well known that 8 
admits an automorphism J of order 2 whose fixed points are precisely the 
o—29+2 points of W. J is simply the interchange of the two sheets of 8 
mapped over the sphere by the function with two poles on 8 which charac- 
terizes the hyperelliptic surface. J is uniquely determined by its order and 
number of fixed points. In fact if 9 is any surface admitting an automorphism 
h of order 2 with 2g +2 fixed points, then 8 is hyperelliptic and h =J. 
This is an easy consequence of the Riemann-Hurwitz relation. In any case, 
we conclude that when 8 is hyperelliptic the kernel of L is (I,J )—showing 
this is a normal subgroup—and we again obtain that H (8) is finite. 

Finally, let us observe that the bound 2g -H2 for the number of fixed 
points of h can be sharpened. For if h41, and if 8 hyperelliptic, h34J, 
then our above results tell us that there is a point PAA(P), Pe W. Among 
all such P choose one whose a,(P) is minimal. Let f be a function at æ, (P) 
and consider f,—f—fh. It is now immediate that h has at most 2«,(P) 
fixed points. Of course this bound depends on h, but since a,(P) Sg we 
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obtain that for any h=4I,J there are at most 2g fixed points while if 9 is. 
hyperelliptic, since a,(P) 2, there are at most 4 fixed points. In 14]; 
Hurwitz only points out the latter result for a hyperelliptic 8 but not the more 
general result. ` 


2. The representation of H (8) as permutations of W has yielded quite 
a bit of information. One is then led naturally to consider the representation 
of H (8) as linear transformations of the spaces Dm and Am. Explicitly this is 
done as follows. Let 8€ Dm have the Den at P € 9 in terms of a local 
parameter z at P as 8 = (azt +: - -)de”. For heH(8), let P—h(P) 
and say 0 at P, in terms of a local u at P, is = (bui +-  -)dur. 
Since h- is conformal, the mapping h is given locally at P,=h"(P}) as 
u= F(z), F (0) 40. We now define h(6) to be the differential which at P 
in z is given as h(#) = (b;(F(z))i+- - -) (F (z))” dz”. Concisely, we may 
write h(@) = 06h" and it is immediate that h(@) has behavior with respect to 
zeros and poles at A(P) as does 6 at P. Clearly 90— h(0) is a linear trans- 
formation of D,, onto itself which takes Am onto Am. For clarification let us 
denote by Rm the representation A> Ry(h) where Rm(h) is the linear trans- 
formation determined by h of Am onto An. 


THEOREM 1. R,, is faithful if m= 1 except when g=? and m is even 
in which case the kernel of Rm ts (I,J). 


Proof. Consider first R, and assume hz£I. If 8 is hyperelliptic and 
_ h==J then it is well known that J(6) ——6 for all 6€ A, (this can be seen 
by writing down the differentials explicitly but we shall give an independent 
proof of this in a later section) so that R, (J) is not the identity on A;. If 
now hJ and S is arbitrary, there is a Pe W such that kh(P) P and a 
0E A, with at least g zeros at P since there is a gap at P greater than g. 
Then h{6) has at least g zeros at h(P) so that h(6) —6 implies 6 has at least 
2g zeros which is absurd. Thus h($) 546 and so R (h) is not the identity 
ifh=4J. If m>1, using the same notation and argument we conclude that 
om E€ Am cannot satisfy (0%) — 6" so that Ra(h) is the identity on Am only 
if h=. If m >i and h-=J then for g > 2 one observes that there is always 
26€ Am such that J (6) = — 0 while if g—2 and m > 1 then J(6) = (—1)"6 
for all 6€ A„. This completes the proof. 


COROLLARY 1. H(8) ts represented faithfully on H,(S), the first 
homology group. 


Proof. Let a, b 17g be 2g cycles of a canonical dissection of 8 
which generate the first (simplicial) homology group. Again ,—>h(a,), 
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bj—> h(b,)—where h(a,), h(b;) is simply the cycle consisting of the point set: 
image of a,, b; resp. under h—is a representation of H(S). Let 6:,°--,0,€ Ay 


be a normalized basis 80 that f 8 — ôy (Kronecker delta). Now J A) 
âj 2 
= Í A, since h(6,) = 6;k-*—s0 that if h is the identity on H,(8), h(a) is 
a; $ 


homologous to a, and so f h (0i) = ôy and so h (0) = 4; since the normalized 
a 


= 3 
basis is uniquely determined. But h(6,) = for 1 SiS g implies h—TI by 
the theorem. J 


COROLLARY 2. If huha € H(8), huha then h, is not homotopic 
(topologically) to ho. l 


Proof. For if homotopic, then hh, is the identity on H,(S) and then 
by the previous corollary A, = ha. 

Now let H C H(8) be a subgroup. Relating P,,P,¢ 9 if P,=h(P;) 
for some Å € H is an equivalence relation and it is not difficult to see that the 
quotient space § == §/H may be given the obvious conformal structure with 
respect to which 4 is a Riemann surface and +: S—>8 is a branched analytic 
covering whose branch points are at those points of S- which are fixed under 
some h€ H. In fact r defines 8 as an N sheeted covering of 3 where N is the 
order of H and a point P € 8 has branch order N(P) —1 where N(P) is the 
order of the subgroup of H leaving P fixed, which we call the stability group 
of P. Er(P,)—=r(P,)—=Pe$ then P,, Pa have conjugate stability groups 
and so N (P1) =N (P2). In this way we may define unambiguously N(P) a8 
N(P) where P is any point such that =(P) =P. With this notation we observe 
that P=r(P) may be written in terms of suitable local parameters Z, z at P, 
P resp. ag Z =m 2N(P) m gN, We denote the genus of § by 5 and the spaces 
of differentials on § as Dy, and Am. 6€ Dy, is called H invariant if h(6) —6 
forall he H. The set of H invariant differentials form a subspace Dy” C Dy 
and similarly we have a subspace Am” == Dm" N Am. I Be Dy it may be 
‘lifted? to a differential 0 =m" (8) € Dm as follows. Let P=r(P) be 
locally Z= 24) and say 6 at P in Z is 6—=(a,a*-+- - -)dz™. Then define 6 


at P in z as 0 == (ap (2NP))F 4. - +) (Fy dor. By the nature of this construc- 


tion h(6) =9 for all h€ H and so 0€ Dy and n”: Du —> Dm is in fact an 
isomorphism (into). Observe that if 6 at P has a zero or pole of order &(= 0) 
then w*(6) at P has correspondingly a zero of order u, —m or 
en of order (k— rn +m. - 
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_ To show that a is in fact onto Dm” we ‘lower’ differentials from D„# 
to Dm. For this we note that the stability group of any PES is cyclic. 
Indeed, one can find a suitable parameter z at P such that any A leaving P 
fixed is locally > »(h)z where | »(h)| 1 is a primitive N(h)-th root of 
unity, N (h) being the order of h. The map h->y(h) is then clearly an 
isomorphism of the stability group of P onto a finite abelian group of roots 
of unity. But a group of this latter type is necessarily cyclic. Now if 0 € Dy”, 
PE, h of order N (h) == N(P) >1 generates the cyclic stability group of P, 
z a local parameter at P-such that h- is locally z—> pz, p primitive N (P)-th 
root of unity let 6 at P in z be given by 9 — (as2” +: : :)de”. The hypothesis 
OE D, means h(@) =6 so that we must have 


(ay2" + ons dem — (an (ua) + . *) um dz 


Thus the only non zero coefficients a, which can appear are when k T m==0 
(mod N (P)) and in fact 8 appears as 


(1) (et: Fun. - *)da™. 


Now if P,€ 8 and (P,)—r(P), because 0 is H invariant we may find a 
parameter z at P, in which @ again -has the expansion (1). Thus if P=r(P) 
we may unambiguously define a differential a ‘which in a local para- 
meter z = 2) at P is 


6 = (dan N 
o : ey 


= Fe = (luy (Pym 2h) = > +) dg 


Then 6—> (6) is a linear transformation of D,,” into Dm with inverse mt. We 
have therefore established: 


THEOREM 2. r: Dy! = Dey ‘ 


This isomorphism can be regarded as an identification of the two spaces for it 
does not involve any choice of basis, i.e. it is canonical. ` 

How do the spaces Amf, A,, behave with respect to this isomorphism? 
If de A, then by our previous observations it’ is clear that’ (6) € Amë. 
However, if 8 € Am” is (1) above, then nN(P) — m 20 but f= (9) starts out 
like z"-™ which may be a’pole. Conversely we see that a de Dm having poles 
may lift to r + (6) € Am. However in either case the poles can occur only at 
the finite set P,,- - -, P,, of branch points on 8, i.e. those P with N(P) >1. 
Thus if H has no fixed points, m: S-8 is smooth and in this case r: 
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Am”. = Ay, Assuming now there are t> 0 branch points on 8, define, for any. 
integer m and P=z(P), the integer (P, m) =— (P,m) as the least integer ` 
such that 

(P,m) N(P) —m=0. 


Then (P, m) = m whenever N (P) = N(P) <1 while at a branch point, since 
N(P) =N(P) 22,15 (P,m) = m/2-+1. Hence from (1) and (2) above, 
we see that if 0€ A,” then (6) has at most a pole of order m— (P, m) at 
Pic 8, 1SiS¢t and is otherwise regular. Conversely any such 6 lifts to 
w(6) €Ag#. When m—1, (P,1) — (P,1) —1 for all points so that in this 
case no poles can appear and r: A,7=4,. Assume now m=2. We 
have already characterized the isomorphic image of Aw” under w and so 
we may compute the dimension of A„# as the dimension of the space of 
differentials d€ Dm which have at most poles of order m—(P,,m) at Ë, 
1 iS and no others. This is a standard application of the Riemann-Roch 
theorem as follows. Assume 6€ Dw is a differential satisfying these require- 
. ments so that its divisor is (6) — Py Qs, 1 Sit, n= 0, m= (Pym) — m, 
and 4(#) = m -+ Sum 2m(5—1). Then all other differentials 64 EDn 

with this property are of the form 76 where f is a function on 8 whose divisor 
is a multiple of the divisor b = PPum)-m-m G n, The space of such functions 


has dimension r(b) =d(b>) +1(0+) +1—g. Now 
40°) = Smt Ent 3 (m— (Pym) —2m(G—1) 
+3 (m—(B,m)) > 2m(G—1> 2g —2 


if g > 1 so that i(b) =0 while if g —0 or 1, 1(b-*) = 0 because then there 
are never any differentials in A, with zeros. Thus we have that 





dim Anë =r (b) = (2m —1) (3—1) +3 (m— (Po m)). 


Now this analysis was predicated on the assumption that there was a non zero 
de D,, having the desired properties so that all others could be obtained as 
76. Clearly if 5>1 then since A, C (Am) and dim A, =1 this require- 
ment is met. If ĝ = 0 this may not be so. For example, if 5-0 then t= 3 
is an immediate consequence of the Riemann-Hurwitz relation. Also in this 
case 2m(G—1) = — 2m so that any differential of type m on the sphere has 
at least 2m poles. But if t= 8, m == 2 then any differential in r(A,®) has at 
most three poles which is impossible, hence (Am) =0 and dim Anf —=0. 
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‚Ei>3, m=2 it will in general depend on the properties of the covering, 
i.e. the numbers (P, m), whether dim Am” > 0 or not. We summarize our 
results in the following theorem. 


` ‘Toone 3. (a) If H has no fixed points then 
wi Ag? = Ag, and dim Ag? Z 2m—1+ bim 
Assuming now 3 has t>0 branch points, then 


(b) m: A= A,. In particular dim A,” = @ so that there are invariant 
abelian differentials of the first kind different from zero if and only if Š is 
not the sphere. 


(c) If m>1 and G40, then 
1S dim Agi — (2m—1)(G—1) +X (m— (Pym). 


If 5=0 then dim Am” may be zero but in all cases is given by max 


(0,1—2m +X (m— (P,m))). 
= 


The only point needing comment is (a) where dim Am” = 2m — 1 + 81m 
is stated. This is so, for, ĝ = 2 in the case of a smooth covering. This may 
be seen from the Riemann-Hurwitz relation or by observing that since g = 2 
its universal covering surface is the disk and hence if m: S->8 is smooth § 
admits the disk as universal covering surface which implies ĝ = 2. 


3. We now wish to calculate explicitly the matrix representation of Rm, 
at least for a special case. That is, consider an element h€ H(S) of prime 
order N and let H be the cyclic group generated by A. Our first observation 
is that for suitable choice of basis in Am, Rm has diagonal form. Indeed, 
since Am ==J, its minimal polynomial M(A) divides AN—41, hence has 
distinct roots. A known result of linear algebra is that a matrix can be 
diagonalized if its minimal polynomial has distinct roots. Another way is to 
recall two elementary facts of the theory of representations. Namely, every 
irreducible representation of an abelian group is one dimensional and that 
every representation of a finite group is completely reducible into a sum of 
irreducible representations. Thus the matrices of a representation of any 
abelian group can be brought simultaneously into diagonal form. 

The irreducible one dimensional representations of the cyclic group H of 
order N are simply obtained by A> p OS 7S N —1 where p—e?F4/N_ In 
the diagonal form of R,(h) let us denote by n; the multiplicity of p/. Thus 


S 
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1 occurs N, times and > nj==g. But clearly 1 occurs with a multiplicity equal 


to the dimension of “the space AF of H invariant differentials which by 
Theorem 8 gives n, = ĝ, the genus of 8/H. The Riemann-Hurwitz relation 
informs us immediately that ĝ < g so that for some index k, 1<k=N—1, 
n20. (This incidentally is another proof that R, is faithful.) We now 
make use of the simplifying assumption that N is prime by noting that in 
this case H has no proper subgroup so that any point fixed under an element 
of H is left fixed by the whole group H. Hence in the covering m: S>8 
== 9/H every one of the t>0 branch points P, :,P,E€E 8 are of order. 
N —1 and the Riemann-Hurwitz relation is 2g —2 = N(2g—2) + (N—1)t. 
Now n340 means there is a 0 € A, such that h(0) == „9. This implies that 
if Q € S, not a branch point, is a zero of 6 of order q then each of the points 
h (Q), 1SjsN—1, is a zero of order g. Thus the divisor of 6 has the 
form 
(0) = Pım- -Pm - Oita (Qy)e- + -hN (Qu 


m,= 0, 920, where zZmtN Z g= 2g-—2. (If t—0, any expressions 


involving indices running from 1 to ¢ are simply omitted.) Note that q; may 
be arbitrary but not the my. In fact if z is a local parameter at a branch point 
P such that A is locally z—> nz, n a primitive N-th root of unity and 6 
locally (ao + az -+: > -)dz then the condition h(@) == .*6 says that 


(dy +0, (12) +- Indem p (dy Hag +: - Yde. 


Now if def, 1S pS N—1, then the only non zero coefficients a, possible 
are when dy”! == app? == AnP, or n -+ 1=p (mod N). In particular the first 
non zero coefficient has index of the form rN + p— 1, r = 0 an integer. Now 
of course at each branch point P, there is an m, pi, 7 which needn’t be the 
same. Note that the y, pı do not depend on @ while r, does. Nevertheless we 
have that the order m, of the zero of 0 at P; is of the form my==r,N + p—l. 
We are now in a position to apply Riemann-Roch. For if ¢ is another differ- 
ential satisfying A(¢) —yp*d then #/9=Ff is an H invariant function on 8 
with poles at most of order q; at the non branch points Q,, ACQ), -© -, AN-*(Q,) 
while at any branch point P;f has at most a pole of order r;N, for ¢, by what 
we just noted above, has at P, a zero of the form «N + p,—1, r* 20. On 
the other hand any H invariant f with these properties gives ¢ == f6 satisfying 
h(¢) —y%p. Hence ny is the dimension of the space of such H invariant 
functions f. By the analysis of the previous section these may be lowered. to 
functions f=#(f) on & and these are then multiples of the divisor ~ ` 
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b= Pyne Pre Qu. ++, and m—r(b) —d(b4) +i(b4) 417; 
a i j ; l ; 
d(b-) =D t hy We know = (rN +m—1) ue ae faa so that 


N | aS 
ne ` t 
tSpSN—1, (N—2)t2=>% (m—1) Z0, 
2 


m 


d(b*) = Since 





—2 _ (N—2) 
E N 


ana Se as 2d(b")= ss AYE t. There are now two possibilities. 


If #0, the a(b) = IR _ 2g —2 and i(t) — 0 or 1. Butif 0) —1 
there is a differential FE A, which upon lifting to Y — x (Ẹ) € A, has zeros 
precisely at the zeros of 0 but 7 £9 since h(7) = & while h(6) = p*é, kA0. 
Thus 1(b-*) == 0. If t> 0 then ` 
2g—2 (N—2),_ 2g—2 (N—1) 
N KON yo 
and so we obtain directly that i(b7)=0. In any event, we have that 
een öd— 1 in the case that t0 while if t > 0 there 
> 29—2 _ a) 
N 





d(b) > == 29 —2 


—jZ2mZ t+1—g which 


may ts written as G—1-- Be Again, if i=0, 


let us assume that for indices a ' ‘ky 1ShSN—1, 1lsSisr, m0 
Na 

while otherwise ną =0. Since ing we have that -+ r(ĝ—1) —g. 
fro 


is an inequali 





Comparison with the Riemann-Hurwitz relation 2g —2 = N (2ĝ—2) and 
recalling that 5>2 if t—<=0 (see remarks following Theorem 3) yields 
r=N-—-1. We summarize our results as 


~  THRORRM 4. If he H(9) has prime order N and t= 0 fined points and 
ny is the multiplicity of pi in the diagonal form of Bı(h), p= et"tIN, 
0Sj5N—1, then 
(a) no=ĝ= genus of 8/H, H being the cyclic group generated by h. 
b) If.t=—0, ny=ĝ—i for lsjsSN—l. 
~ (c) If t> 0, there is at least one indes k, 1SkSN—1, such that 


1,70, and for any such indes, 


a) 


g—14 SS) imh. 
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A similar analysis can be done for the representation matrix R,,(h) for 
m > 1 and the particular case m = 2 has been examined elsewhere [5]. In 
this connection the reader may consult the article of Rauch [7] where certain 
of these formulas are utilized. 


4, Fix m1 and let k= dim Ám = (2m—1)(g—1) + ôm we are 
assuming S has genus g = 2 in what follows. If 6,,: - +, is an arbitrary 
basis for Am and z a local parameter at Pe 8, let r(t), for t an integer = 1, 
denote the rank of the matrix 


6,(2), ng 9. (2) 
(se -sB (2) } 
OED (z), +» +, A, (2) 
One verifies easily that r(t) is independent of both the local parameter z and 
the choice of basis 6,,- - -,6,. In fact k—r(t) is the dimension of the sub- 
space of A» vanishing with order = t at P. Thus r(t) = k for t > 2m(g—1), 
for any 6540 in Am has only 2m(g—1) zeros, while r(1) =1, for not all Am 
can vanish at a point. Also, r(t) =r(t—1)-+1 if and only if there is a 
0E Am with zero of order t—1 at P. Ast goes from 1 to 2m(g—1)+1, 
r(t) changes from 1 to k. If we agree to set r(0) = 0, then we see that there 
are precisely % positive numbers t, 17 Sk such that r(t;) = r(y— 1) +1, 
and these satisfy It, <t <-  <yS®m(g—1)+1, 427. Let us 
call this sequence of & numbers the sequence of m-gaps at P and denote it as 
y” (P) = (y (P), + +, ye"(P)). We have then, by definition, that a number 
y is an m-gap at P if and only if there exists a 0€ Am with a zero of order 
y—1 at P. For m=]1, one obtains the gap sequence defined in the first 
section. Here also, as in the case m — 1, one may show (see Hurwitz [4]) 
that there are only a finite number of points for which y,” > k, and these may 
be called the m-Weierstrass points. 

Using the m-gap sequence one may construct a normalized basis for Am 
at P with respect to a given local parameter z as follows. For convenience, 
since m, P are fixed, let yı’ ' “, y be the m-gap sequence at P and set 
m= y1. Let for 1 Sik, d€ Åm have a zero of order wat P. Then in 
the parameter 2, 

= (ap Mar + = *)dz™, Gy, 0. 


The differentials 4; are clearly linearly independent and being k in number, 

form a basis of Am. Then the differentials ys = (a, N)" — > ap O(a O) A 
>i 

are again a basis of Am and satisfy the following normalization: 


ti (by, + - der, ba ®—1, and b,, = 0 for j >i. 
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The basis y'> -,yx is uniquely determined by these conditions and will be 
called the basis for Am at.P, 2. 

If now h is an automorphism of § and P—h(P) is a fixed point, consider 
Ra(h) with respect to the basis % at P. Since Rm(h) (4) =yh, if ht is 
locally z> ez, one has 


Bem (h) (Ya) = (C(e) bg Merz™ + + eda, 


k 
On the other hand, Ran (h) (41) = Gpp where (cy) is a non-singular matrix. 
ja 


Since R„(h) (44) has the same order zero at P as does y; we must have cy—=0 
for j < i, while by the above expansion for Am(h) (ys) and the normalization 
of the yy, we see that yet", c,=—=0 for j>i. Thus the matrix R„(h) 
is obtained explicitly as a diagonal matrix. We summarize our results as 
follows. 


THEOREM 5. Let y1,:--,ye be the m-gap sequence at P and suppose 
P=h(P) for an automorphism h of S. Furthermore, let h> at P be gwen 
by 2— ez, where e is some primitive N-th root of unity, N being the order of h. 
Then with respect to the normalized basis of Am at P, z, Bm(h) ts the kX k 
diagonal matrix, with diagonal (er 1,---, m1), In particular, the 
character Xm of the representation Rm is 

Xm(h) = trace Ry (Rh) = er! Sen. 

The importance of this theorem is that it gives Em(h) in terms only of © 
the rotation of A at one fixed point P, and the m-gaps at P. On the other 
hand, Chevalley and Weil [2] have given a formula for the multiplicity of a 
given irreducible representation in Rm which depends on the behavior of h at 
all the fixed points. A combination then of these two formulas enables one 
to obtain information, sufficient in certain cases, to explicitly calculate gap ` 
sequences. In this connection, see [6]. 

For an application of Theorem 5, take m—1, A an automorphism of 
prime order N, having t > 0 fixed points. Let H be the cyclic group generated 
by h, and assume there is a fixed point P=-A(P) which is not a Weierstrass 
point, P ¢ W, so that y= j, 1S jg. Now ify—qN +r,920,0<r=<N, 
is the result of dividing g by N then in the diagonal (e,---,e7), 1 will 
occur exactly ‘q times as eV, 2,---,@%. But we have already ascertained 
(Theorem 4) that the multiplicity of 1 in the diagonal is ĝ. Thusg—gN + r. 
Comparing this expression for g with the Riemann-Hurwitz relation, 2g —2 
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). Since ¢ is an integer 


— 1 


—W(2g—2) + (N—1)t gives + 





‚r=N-—1, which 
give corresponding values for t as t= 2, t= 3, t=4. This yields 


we must necessarily have that either r—0, peal! 


Tueorem 6. If P=h(P), P W, then there are at least 2 and at most 
4 fixed points under h2 The genus 5 of S/H is gwen by G=[g/N], the. 
greatest integer in g/N. Writing g =N +r there are only three possible 
cases: 


(a) r=0, 9=GN, t=2. 

N= 
(b) r=, g= HH hie. 
(ce) r=N— 1, g=—(G+1)N—1, t=4. 


Since the theorem assures us of the existence of another fixed point, say 
Py, let (yu' ` <, yg) be the gaps at P, and suppose h at P, is locally 2— 2. 
Then—understanding equality of diagonal matrices, in the present context, 
modulo the order of the terms—we must have 


R, (k) = diag (ce, > -, 8) = diag (m, g me). 


This generally should yield some information about the y} However, in the 
general case where the y; may be quite arbitrary it seems that nothing more 
precise can be said. Also, we wish to consider the case where we are given 
only that h(P) =P€ W, not covered by Theorem 6. For specific results 
let us consider the following two cases which have the simplification that the 
gap sequence is known for a point as soon as it is known whether or not that 
point is in W or not. I. S hyperelliptic: there are œ = 2g + 2 points in W 
at each of which the gap sequence is 1,3,5,- > -,2g—3,2g—1. II. 8 is at 
the opposite extreme, i.e. there are „= (g—1)g(g-+1) points in W, each 
having gap sequence 1,2,3,---,g—1,g+1. From now on we denote by 
diag(qa,,' ` *,@,) an nX n diagonal matrix with these elements as diagonal. 

I. 8 is hyperelliptic. Let J be the unique involution which leaves W 
fixed. Since J has order 2, at any point Pe W, J—=J"! is locally z—>— z3, 
e==—1 and so 


R,(J) — diag ((—1), (—1)*,- - +; (—1)?#*) = diag(—1,—1,- - -,—1). 
From this, J (0) =—6 for every € A,. This fact is usually proved by 


*R. Accola has recently pointed out to me that this result can be obtained directly 
from the Riemann-Hurwitz relation without Theorem 5. 
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explicitly calculating the differentials which this method obviates.. Now let 
us prove the following: If h is an involution of 9 and A(P) =P, Pe W, 
then =J. For we have locally at P, z->—2 so 


Ry (h) = diag((—1), (—1),- © +, DR), 


so that since R, is faithful A—=J. Hence given any involution h on S, either. 
h has no fixed points, or has non W fixed points only, or is J. In case of 
non W fixed points, the three cases of Theorem 10, since N == 2, reduce to 
1) g=2G, t=2; 2) g—2g +1; where G= [9/2]. 

Assume now A is an automorphism of prime order N, such that 
R<N<Rg and say P=h(P)EW and h> is locally z— «z. Then 
By (h) = diag (e, è,  -,ert). A 1 occurs at eY,8%,---. Write 2g—1 
=—qN +r, 0Sr<N. Then if q is even, 1 occurs q/2 times, and if qg.odd, 


1 occurs tt times. Hence if q even, 5—q/2 and 2g-—-1==29N +r and 
TIER LEL o 1-1) N +r. 


1) If _ (2g — 1)N +r -+ 1, comparing with Riemann-Hurwitz gives 
telt+ y {> % that a) r=0, t=1, (2g—-1) = (2G—1)N or b) 


rao N—1, t==2, 2g—=29N or g=öN. Now we claim the case a) cannot 
occur. To see this we recall the representation of A as a permutation of W 
called L(h). Written in cycle notation, L(h), since of prime order N and 
operating on 2g -+ 2 letters, must consist of say L, cycles each of N elements 
and L, cycles of single elements. Hence 1,N+2,—g-+2. But clearly 
La = tw, tw being the number of fixed W points so thet DiN + tw == 2g 4-2. 
However in a) above 2g — 1 = (25—1)N so that 2g + 2— (29-—-1)N +8, 
and since N > 2, either ty = 3 or ty = 0 and N —3, both of which contradict 
t==1. Also, in b) the second fixed point must also be a W point. This may 
be seen in two ways. One is as before to write L,N-+ty—=2g+2. But 
here g = GN, so 2g +- 2 == 29N -+ 2 = LN + ty so that ty —t—2. Another 
way is to recall that hJ — Jh always so that if h (P) — P then Jh(P) = hJ (P) 
so that J (P) fixed. Hence if the second fixed point P were not a W point, 
there’d be a third fixed point J (P), contradicting t=2. 


2) Consider 2g — 1 = 2gN +r; comparing this with Riemann-Hurwitz 





1 
we have t= pE, Since £ is an integer and 0S r< N, then, neces- 


särily, r == N — 2 and t=, 2g = (2G¢+1)N—1. 
But then 3g +2= (2G +1)N +1 so that ty =1 or ty = N +1>3 
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which cannot be, hence ty =1 and the two other fixed points are not W 
points. Now g—0 implies N == 2g + 1 contrary to our assumption; hence 
I 2g+1  29g-+1 se 1 
> = 
G2Z1and N TES < 
THROREM 7. Let 8 by ene Any involution on 8 either has 
no fixed points, or only non W fixed points or is J. If h has prime order N, 
2<N < 2g, assume there is a W point fixed. Then there are only the two 
possibilities: ; 





<g. Summarizing these results we have: . 


1) g= ĝN and there are two W fixed points and these are all the fixed 
points. 





2) N= LEL 521,13, the other two fined points being P, J (P) 





TEE 
for PEW. 
Now in both cases, 1) W—=g/§Sg,2) N tos OP <i +4 <q 


we see that a necessary condition that a W point be fixed is Ng. But if 
g <N < 2g, there being no fixed W point, then 2g -+ 2 = L.N, so the only 
possibility then is N=g-+-1. Hence we have the 


COROLLARY 3. The only possible h of prime sds N, g <N < 2g, ona 
hyperelliptic 8, is for N =g + 1, prime. 


_ Finally to complete our survey of the hyperelliptic case, we must consider 
prime order N > 2g. But we must have 2g + 2 == LIN + ty, so the only 
possible case is N—2g-+1 and there is one fixed W point P. Thus R,(h) 
= diag(c,e*,- - -,e9) for some N-th root e; hence 1 does not occur at all 
so 5-0. Then by Riemann-Hurwitz we get 2g —2?—=—2(?g -+ 1) + 2g 
or t= 3 and the other two fixed points are some P and J(P). 

We can give an illustration where this last case arises. Consider the 
surface defined by y?=2*—z which is of genus 2 thus hyperelliptic. Then 
one see that >, y— dy where em FHS ig an automorphism of order 
5=2.2-+1. The fixed points are clearly the single W point lying over z = 0 
and the two corresponding points lying over zo, so that the theory is 
verified. To compute R,(h), at the point over 70, y is a local parameter, ` 
and so ht is locally y—>—e?r#/°y, Now —e¢?rt/10-@, The gaps are 1,3 
—2g—1. Thus R,(h) = diag(e, (*)’—=«e), from which we also see that 
g —0 as expected since no 1 occurs. To verify this expression for 2,(h), 





consider the basis for A, given hy, ZZ | Thn > CE _ Me. 
y’ y yo 
~2 

member h (6) — dh") and #22 zdr _ sds 





E g (M) = ding(#). 
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II. We now consider the surface $ with (g—1)g(g-+1)W points, with 
gaps 1,2,° * ,9-——1,9-+1 at each one of these points. Let h be of prime 
order N. Ifa W point P is fixed, then for some e, 


R,(h) = ding (ee, j ee), 

Write g=qN +r. Then we have the possibilities 

1) r=0,1 occurs g—1 times, g—=(¢+1)N 

2) r—N—1, Í occurs g+1 times, g=—gN—1 

3) 0<r<N—1, 1 occurs q times, g = JN +r. 
Say now a point P, ¢ Wais fixed also. Then we know either r—0,r— N —1 
or rt, But then when r = 0 we know g = @N and r=» N — 1 implies 
g= (G+1)N—1 (by Theorem 6) which are incompatible with 1) and 2) 


above. Thus necessarily then + 





-th root y, 


we must have 
diag (e, Egeas a, dp). 

Let us note that if N = 5 = 2.2 + 1, r—2, this might indeed occur, if say 
e= 77, then Te and e = amy so that (e, eè) = (n, 7"); also if 
N ==3, r==1, 80 we may have (e) == (q) if @==y. Now assume N > 5 so 
that r> 2. Clearly e—=n is impossible. Let n° == e where l1<aSr. Then 
(r—1)a = 2r—2> r so that there is an integer b, 1 < b Sr— 1 such that 
r<ab<®r+1. But then e occurs in the set (ge, © +, ec), and 
e= 7% which does not occur in the set (y,77,'--,7"). Thus if N>5, 
either there are only W or non W points fixed. Now if there are no W points 
fixed, we must have (g—1)(g)(g+1)—JL,N so that N, being prime, 
divides either g—1, g, or g-+1. Referring now to Theorem 6, assuming 
there is a non-W point fixed, we see m in cases (a), (c), X], N | (g—1), 


TEED However, in case (b) g == ĝN pE 





‚so that if N >3, N divides 


- none of g— 1, g, g +1 so that this case is eee Now assume there is 
a point PE W which is fixed. Consider now again the three possible cases 
we had before (not those of Theorem 6). In 1) g~(G-+1)N and on com- 
parison with Riemann-Hurwitz 2g —2—N(2g7—2) + (N—1)t we have 


tom 4 yoa =?, or (1b) t==5, N=3. Since 


t>4 all the fixed points must be W points, but in (1b) we then have 
(g—1)(g)(g-+1) =3L, +5 which is impossible because one of the three 








14 
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numbers on the left side is divisible by 3. Now in 2) g—gN—1 and again 
we deduce in the usual way t= 2— wo and since were assuming 0, 
we must have N = 3, t= 1, but again by (g—1)g(g + 1) =3L, +1, this is 
seen to be un Finally, in 3) g = N +r, 0 <r < N—1 which gives 
— and {=3 and if N > 5 weve 
seen these are a W points, so that (g—1)g(g +1) =L,N +3. 








t= 2 + To so that necessarily r = N 


Summing up then the main results here, we have 


. THEOREM 8. On a surface with (g—1)g9(g+1)W points each with gap 
sequence (1,2,: ',9—1,9-+1) any automorphism of prime order N > 6 
has either only non W or only W points fixed. If only non W then either 
N|g—1 or N|g and only cases (a) and (c) of Theorem 6 are possible. 


If only W, then there are exactly three W points fired and g = GN + a= 


and (g—1)g(g-+1) =3 (mod N). If N S5 and there ts a W point ey 
either N=2 and there are 6 W fixed points, or N <3 and there are 3, not 
necessarily all in W, fixed points. 


As an example of the use of some of the abstract theory developed above, 
consider a surface § defined by the polynomial y° = (2 — a,)*(« — 0)? (£ — ag)*. 
Both 2, y are functions on S. Let Po, Pi, Po, Po E O be those points z(P,) = a 
i= 1,2,8, z(P,) ==% ; these are the only branch points of z each of order 4 
and by the Riemann-Hurwitz formula S has a genus 2g —2 = — 10 +16 or 
g==4. In particular v has only 5 poles at P, and y has only 9 poles at P, as 
is easily verified. Also y has precisely 9 zeros, 2 at a,, 3 at do, 4 at as. 

S admits an automorphism of order 5 by defining for P = (a,y) € 8, 
h(P) = (x, ey) where e is some 5th root of unity, «541. It is immediate 
that Po, Pı, P2, Ps, are the only fixed points of h, each of order 4 and that 
a: S—>§ in this case is identical with s: S—> sphere. In terms of a local 
parameter at any Pi h is locally z— ez and ht: z— qz where q= € e 

Let y(Po) = (Yo Y2 Ya» y4). Then we know that 


Rı (h) ce diag (9%, 4%, 77, 7%). 
Let us determine y(P,). Clearly fi —=r is a function at P, with 5 poles. By 
inspection we obtain 
ne Ls 27 __ 2 
fs = Ban a wa) ‚? poles at P, 
h= =) ee @ m) ‚6 poles at P, 
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Be Braten ee 8 poles at P, 


Thus P,¢ W and y(P.) = (1,2,3,4) so that R,(h) = diag (n; 7°, 7%, 7*)- 
Observe that 7°==1 does not appear, as was to be expected, for § here is the 
sphere and 5=0. Consider now y(P:) = (y1, Yo Ys, ys). We know y,==1, 
ye < 8 and R, (h) = diag (n, 7%, 7%, 7%). If ya = 3 the surface is hyperelliptic 
and so 5 is then a gap, so 7°==1 appears which is impossible, thus y,=—=2 
and this forces yg==3, y,==4. Hence, this clearly holds at Pz, Ps, also, and 
have the same gap sequence. 

One may also proceed in a different way, i.e. determine explicitly R, (A) 
by computing the differentials and then find the gap sequence by means of 
this at Po, Pı, Pa, Ps. In fact, by inspection, one sees that 








EB Zara. Ta) eri) OY a RE See an 


(2 — 0,)(2 — ag) da dz 
em y? 3 6, = y` 


Then 6,h-1 = 64, Oah = 972, Oah = 7303 and Oah = *0, 80 that B,(h) 
== diag (y, n°, 7°, 7*). From this one now may determine the gaps at each of 
the fixed points. 





9s 


L 
Consider the general case yY J] (£e— a)”: where N is prime and we 
1i 


assume 1 =m, N—1 and M =m, is such that (M,N) =1. This is a 
surface S of genus g where 2g —2 = — 2N + (N—1)(L-+1) or 


(N—1)(L—1) 
g= 5 . 





This last relation is by observing that z is a function with branch points of 
order N — 1 at the points Po, Pap’ © -,P, where z(P,)=a,i=1,' : ‚Land 
a2(Po) =o. y is a function with M poles at Po and no others. 

It is interesting to observe that the genus depends only on N and L and 
that the exponent m, of (c—a,)™ is irrelevant. This 9 admits the auto- 
morphism of order N defined by (2,9) — (z, ey) where X —=1, e41. Again 
the fixed points are precisely Po, Pap: + +, Pr and if the gap sequence at P, 
say, can be determined to give R,(k) we may then as before try to use this 
to compute the gaps at Pi,-- +, Pz. However, it is not clear that in general 
this method always gives complete results; for example if N is small with 
respect to L and g, since the powers of elements in R,(h) are always reduced 
mod N, a decisive determination of the gap sequence may not be available. 
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In certain cases, as in the one worked out above, this method is though quite 
useful. 

Finally we can observe that in the case of a surface © determined by such 
a polynomial, the fixed points Py, P,,---,Pz, are either all W points or all’ 
l 1 
T— u 
Hence N is a non gap at each. Now (N —1)(L— 1) =2g so N = rt 1 


(if L—=1, g = 0 which is of no interest here) ; thus if A>3, N<g+1land . 
N =g +1 only in the case Z=3, as considered above. Hence if L> 3, 
N<g-+1 and so each P; is a W point. Note that this result follows also 
independently from Theorem 6, for since when L > 3 there are at least five 
fixed points none of them can be.a non W point for in that case by Theorem 
6 there are at most four fixed points. If L ==2, N=?2g+1 and this is the 
only case in which the automorphism of the type under consideration can have 
as fixed points both W and non W points. For example y" = (z — a ) (£ — a). 
Here $ is of genus 2, hyperelliptic, and if z(P,) =», z has 5 poles at P, 
and y has only 2 poles at Py. Hence P, is a W point. On the other-hand 


Br is a function with only three poles at P,, x(P1) = a,, and ea) 


has only 3 poles at Ps, z(P,)—=a,. Thus P,, P} are not W points. In fact 
P= J (P1) by our previous theory. 


not W points. For 





has only N poles at P4 and z has only N poles at Po. 
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ERRATA. 


Eckford Cohen, Arithmetical notes, V. Vol. 83 (1961), pp. 683-697. 

The term O(a1/*8(r)) in (2.4) is unnecessary and should be deleted. 
(See remark 2.1.) Thus (3.9) and the computation preceding it on page 697 
should be omitted. f 


Morris Newman, Normal congruence subgroups of the modular group. Vol. 85 
(1963), p. 419. Received date should be given as March 13, 1963. 


Arthur J. Schwartz, A generalization of a Poincaré-Bendizson theorem to 
closed two-dimensional manifolds. Vol. 85 (1963), p. 453. 


line 3—T X M—M should be T X M>M 

line 6-—(TOQ—Q) should be (TR =Q) 

line 9—beginning of the line should read fixed point rather than xed 
point. 


